Skip to content

[DO NOT MERGE] Experimental RowFn - #9255

Draft
connortsui20 wants to merge 96 commits into
developfrom
ct/row-fn
Draft

[DO NOT MERGE] Experimental RowFn#9255
connortsui20 wants to merge 96 commits into
developfrom
ct/row-fn

Conversation

@connortsui20

@connortsui20 connortsui20 commented Aug 7, 2026

Copy link
Copy Markdown
Member

EXPERIMENTAL

(for benchmarking purposes)

See #9128

@connortsui20 connortsui20 added experimental Experimental change; requires broader validation action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR labels Aug 7, 2026
@github-actions github-actions Bot removed action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Aug 7, 2026
@codspeed-hq

codspeed-hq Bot commented Aug 7, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will degrade performance by 6.5%

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 39 improved benchmarks
❌ 50 regressed benchmarks
✅ 1873 untouched benchmarks
🆕 51 new benchmarks
⏩ 89 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation case_when_nary_10_conditions[10000] 747.5 µs 1,812.8 µs -58.76%
❌ Simulation baseline_eq[4, 65536] 586.6 µs 1,219.1 µs -51.89%
❌ Simulation case_when_nary_equality_lookup[10000] 515.4 µs 1,060.1 µs -51.38%
❌ Simulation baseline_lt[4, 65536] 602.3 µs 1,218.4 µs -50.57%
❌ Simulation baseline_eq[16, 65536] 690.6 µs 1,324.1 µs -47.85%
❌ Simulation mul_i32_constant 363.5 µs 687.3 µs -47.11%
❌ Simulation baseline_lt[16, 65536] 706.3 µs 1,324.3 µs -46.66%
❌ Simulation case_when_nary_3_conditions[10000] 385 µs 712.9 µs -45.99%
❌ Simulation case_when_nary_early_dominant[10000] 384.5 µs 709.4 µs -45.81%
❌ Simulation case_when_all_false[100000] 1.1 ms 2 ms -44.68%
❌ Simulation case_when_all_true[100000] 1.1 ms 2 ms -44.63%
❌ Simulation case_when_simple[100000] 1.2 ms 2.1 ms -44.45%
❌ Simulation case_when_without_else[100000] 1.3 ms 2.2 ms -42.67%
❌ Simulation case_when_nary_10_conditions[1000] 400.5 µs 686.5 µs -41.66%
❌ Simulation case_when_all_false[10000] 210.8 µs 323.8 µs -34.9%
❌ Simulation case_when_all_true[10000] 215.8 µs 327.1 µs -34.04%
❌ Simulation sub_i64_constant 637 µs 964.7 µs -33.97%
❌ Simulation add_i64_constant 636.8 µs 954.6 µs -33.29%
❌ Simulation case_when_nary_equality_lookup[1000] 309.5 µs 461.3 µs -32.92%
❌ Simulation case_when_simple[10000] 242.8 µs 354.4 µs -31.48%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing ct/row-fn (7b3c404) with develop (ca7f626)

Open in CodSpeed

Footnotes

  1. 89 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@github-actions

github-actions Bot commented Aug 7, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 34d36b1 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 34d36b1 statpopgen 1 Explore Profiling Data
🟢 Done 34d36b1 clickbench-nvme 1 Explore Profiling Data
🟢 Done 34d36b1 fineweb 1 Explore Profiling Data
🟢 Done 34d36b1 polarsignals 1 Explore Profiling Data
🟢 Done 34d36b1 tpch-nvme 1 Explore Profiling Data
🟢 Done 34d36b1 tpch-s3-10 1 Explore Profiling Data
🟢 Done 34d36b1 tpcds-nvme 1 Explore Profiling Data
🟢 Done 34d36b1 tpch-s3 1 Explore Profiling Data
🟢 Done 34d36b1 fineweb-s3 1 Explore Profiling Data
🟢 Done 34d36b1 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 34d36b1 appian-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-3.2%, low confidence)
Vortex (geomean): 0.985x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-compact / ns (0.994x ➖, 1↑ 0↓)
name PR 34d36b1 (ns) base a1057db (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-compact 1989820 1998537 1.00
clickbench_q01/datafusion:vortex-compact 14908097 14323629 1.04
clickbench_q02/datafusion:vortex-compact 52796117 52181404 1.01
clickbench_q03/datafusion:vortex-compact 32650992 32091580 1.02
clickbench_q04/datafusion:vortex-compact 160337496 157915526 1.02
clickbench_q05/datafusion:vortex-compact 245031827 247285069 0.99
clickbench_q06/datafusion:vortex-compact 1942700 2041683 0.95
clickbench_q07/datafusion:vortex-compact 24897974 24202811 1.03
clickbench_q08/datafusion:vortex-compact 242837432 239381012 1.01
clickbench_q09/datafusion:vortex-compact 414535088 413190550 1.00
clickbench_q10/datafusion:vortex-compact 111513398 111420449 1.00
clickbench_q11/datafusion:vortex-compact 150274821 151186270 0.99
clickbench_q12/datafusion:vortex-compact 229656582 242216572 0.95
clickbench_q13/datafusion:vortex-compact 382902229 390094762 0.98
clickbench_q14/datafusion:vortex-compact 239060722 244720665 0.98
clickbench_q15/datafusion:vortex-compact 203479090 197106845 1.03
clickbench_q16/datafusion:vortex-compact 497541039 500129974 0.99
clickbench_q17/datafusion:vortex-compact 497135708 497766003 1.00
clickbench_q18/datafusion:vortex-compact 911846513 927256255 0.98
clickbench_q19/datafusion:vortex-compact 22934996 23435865 0.98
clickbench_q20/datafusion:vortex-compact 231185587 237901652 0.97
clickbench_q21/datafusion:vortex-compact 349803011 350554598 1.00
clickbench_q22/datafusion:vortex-compact 553636554 556744489 0.99
clickbench_q23/datafusion:vortex-compact 1563991245 1540538035 1.02
clickbench_q24/datafusion:vortex-compact 71203757 71859498 0.99
clickbench_q25/datafusion:vortex-compact 107028891 104802830 1.02
clickbench_q26/datafusion:vortex-compact 71741987 72550904 0.99
clickbench_q27/datafusion:vortex-compact 330416535 329448527 1.00
clickbench_q28/datafusion:vortex-compact 1587341517 1547246112 1.03
clickbench_q29/datafusion:vortex-compact 🚀 67567250 76362826 0.88
clickbench_q30/datafusion:vortex-compact 273079795 273798137 1.00
clickbench_q31/datafusion:vortex-compact 295116876 292985068 1.01
clickbench_q32/datafusion:vortex-compact 878992928 860191982 1.02
clickbench_q33/datafusion:vortex-compact 1051215022 1046003251 1.00
clickbench_q34/datafusion:vortex-compact 1010645837 1051600575 0.96
clickbench_q35/datafusion:vortex-compact 172553044 175670457 0.98
clickbench_q36/datafusion:vortex-compact 67792088 67125532 1.01
clickbench_q37/datafusion:vortex-compact 29596430 30475886 0.97
clickbench_q38/datafusion:vortex-compact 18562664 19353469 0.96
clickbench_q39/datafusion:vortex-compact 135082418 140392113 0.96
clickbench_q40/datafusion:vortex-compact 14807472 15196607 0.97
clickbench_q41/datafusion:vortex-compact 17967928 17193007 1.05
clickbench_q42/datafusion:vortex-compact 13955077 13980415 1.00
datafusion / parquet / ns (0.992x ➖, 1↑ 0↓)
name PR 34d36b1 (ns) base a1057db (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1989985 1939969 1.03
clickbench_q01/datafusion:parquet 17821961 17428936 1.02
clickbench_q02/datafusion:parquet 30442531 30934113 0.98
clickbench_q03/datafusion:parquet 26762941 27285772 0.98
clickbench_q04/datafusion:parquet 174959478 172470591 1.01
clickbench_q05/datafusion:parquet 237198641 239073957 0.99
clickbench_q06/datafusion:parquet 2158156 1974807 1.09
clickbench_q07/datafusion:parquet 18254799 18117514 1.01
clickbench_q08/datafusion:parquet 233009952 233446229 1.00
clickbench_q09/datafusion:parquet 373384466 380058601 0.98
clickbench_q10/datafusion:parquet 71337226 72222291 0.99
clickbench_q11/datafusion:parquet 91989850 93658690 0.98
clickbench_q12/datafusion:parquet 239016147 241245074 0.99
clickbench_q13/datafusion:parquet 386538908 388765306 0.99
clickbench_q14/datafusion:parquet 254252833 253551626 1.00
clickbench_q15/datafusion:parquet 194623932 199738215 0.97
clickbench_q16/datafusion:parquet 476529357 487265358 0.98
clickbench_q17/datafusion:parquet 481185863 479994778 1.00
clickbench_q18/datafusion:parquet 920840704 941982981 0.98
clickbench_q19/datafusion:parquet 🚀 23344675 29319349 0.80
clickbench_q20/datafusion:parquet 462367060 472249029 0.98
clickbench_q21/datafusion:parquet 492667340 494234972 1.00
clickbench_q22/datafusion:parquet 659900680 667629026 0.99
clickbench_q23/datafusion:parquet 2852421933 2841127417 1.00
clickbench_q24/datafusion:parquet 54384324 50330040 1.08
clickbench_q25/datafusion:parquet 94581375 97309414 0.97
clickbench_q26/datafusion:parquet 48940299 47917764 1.02
clickbench_q27/datafusion:parquet 531692280 529681335 1.00
clickbench_q28/datafusion:parquet 1546223955 1531783922 1.01
clickbench_q29/datafusion:parquet 41491611 41201965 1.01
clickbench_q30/datafusion:parquet 240091170 240758379 1.00
clickbench_q31/datafusion:parquet 279547511 278503241 1.00
clickbench_q32/datafusion:parquet 842099004 869998749 0.97
clickbench_q33/datafusion:parquet 1092675129 1071414910 1.02
clickbench_q34/datafusion:parquet 1068322651 1080310345 0.99
clickbench_q35/datafusion:parquet 163150437 164888630 0.99
clickbench_q36/datafusion:parquet 114671248 115055342 1.00
clickbench_q37/datafusion:parquet 47690322 47773608 1.00
clickbench_q38/datafusion:parquet 68350067 73481040 0.93
clickbench_q39/datafusion:parquet 225608372 231759890 0.97
clickbench_q40/datafusion:parquet 25515166 27570118 0.93
clickbench_q41/datafusion:parquet 25271629 24776049 1.02
clickbench_q42/datafusion:parquet 27058168 25760878 1.05
duckdb / vortex-compact / ns (0.977x ➖, 7↑ 3↓)
name PR 34d36b1 (ns) base a1057db (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-compact 🚀 11147759 13086098 0.85
clickbench_q01/duckdb:vortex-compact 🚨 24088903 20538780 1.17
clickbench_q02/duckdb:vortex-compact 🚨 36045085 31672292 1.14
clickbench_q03/duckdb:vortex-compact 26589846 24963703 1.07
clickbench_q04/duckdb:vortex-compact 136053106 135550730 1.00
clickbench_q05/duckdb:vortex-compact 175370628 168898486 1.04
clickbench_q06/duckdb:vortex-compact 16235068 17012450 0.95
clickbench_q07/duckdb:vortex-compact 25798331 24051788 1.07
clickbench_q08/duckdb:vortex-compact 180563546 178621842 1.01
clickbench_q09/duckdb:vortex-compact 257924919 259656421 0.99
clickbench_q10/duckdb:vortex-compact 79968436 81350281 0.98
clickbench_q11/duckdb:vortex-compact 97965475 97299891 1.01
clickbench_q12/duckdb:vortex-compact 216760745 201876930 1.07
clickbench_q13/duckdb:vortex-compact 357597385 358435841 1.00
clickbench_q14/duckdb:vortex-compact 210676410 220282101 0.96
clickbench_q15/duckdb:vortex-compact 185631495 189072734 0.98
clickbench_q16/duckdb:vortex-compact 410796530 417303971 0.98
clickbench_q17/duckdb:vortex-compact 393252540 393056797 1.00
clickbench_q18/duckdb:vortex-compact 746001835 727571867 1.03
clickbench_q19/duckdb:vortex-compact 🚨 32338839 28913281 1.12
clickbench_q20/duckdb:vortex-compact 203813376 202569741 1.01
clickbench_q21/duckdb:vortex-compact 303583399 322440369 0.94
clickbench_q22/duckdb:vortex-compact 468033903 475569337 0.98
clickbench_q23/duckdb:vortex-compact 🚀 290657351 331756297 0.88
clickbench_q24/duckdb:vortex-compact 75145281 81517803 0.92
clickbench_q25/duckdb:vortex-compact 95426811 90946304 1.05
clickbench_q26/duckdb:vortex-compact 80049935 79771075 1.00
clickbench_q27/duckdb:vortex-compact 380179947 378875285 1.00
clickbench_q28/duckdb:vortex-compact 🚀 1379115428 1605287208 0.86
clickbench_q29/duckdb:vortex-compact 40758353 40934726 1.00
clickbench_q30/duckdb:vortex-compact 198765974 196378480 1.01
clickbench_q31/duckdb:vortex-compact 357549424 368635085 0.97
clickbench_q32/duckdb:vortex-compact 947670289 955050706 0.99
clickbench_q33/duckdb:vortex-compact 1037824892 1063812853 0.98
clickbench_q34/duckdb:vortex-compact 1097971889 1067377814 1.03
clickbench_q35/duckdb:vortex-compact 220685184 220635033 1.00
clickbench_q36/duckdb:vortex-compact 🚀 37689585 45078780 0.84
clickbench_q37/duckdb:vortex-compact 31008292 34091725 0.91
clickbench_q38/duckdb:vortex-compact 🚀 29930960 38855368 0.77
clickbench_q39/duckdb:vortex-compact 🚀 51009223 59153674 0.86
clickbench_q40/duckdb:vortex-compact 🚀 27904333 32659719 0.85
clickbench_q41/duckdb:vortex-compact 29991445 31437260 0.95
clickbench_q42/duckdb:vortex-compact 25992999 28464068 0.91
duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base a1057db (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 18064688 17226186 1.05
clickbench_q01/duckdb:parquet 17230141 17932090 0.96
clickbench_q02/duckdb:parquet 24050314 23830972 1.01
clickbench_q03/duckdb:parquet 26841343 25963195 1.03
clickbench_q04/duckdb:parquet 131836325 132542203 0.99
clickbench_q05/duckdb:parquet 175900048 186673870 0.94
clickbench_q06/duckdb:parquet 23051528 23253319 0.99
clickbench_q07/duckdb:parquet 18587113 20122493 0.92
clickbench_q08/duckdb:parquet 166370733 162725984 1.02
clickbench_q09/duckdb:parquet 230211958 230249599 1.00
clickbench_q10/duckdb:parquet 58637717 58769503 1.00
clickbench_q11/duckdb:parquet 67995091 67654348 1.01
clickbench_q12/duckdb:parquet 179336029 175628789 1.02
clickbench_q13/duckdb:parquet 316098771 316426034 1.00
clickbench_q14/duckdb:parquet 190927578 187750587 1.02
clickbench_q15/duckdb:parquet 184645191 183140368 1.01
clickbench_q16/duckdb:parquet 373676113 359231731 1.04
clickbench_q17/duckdb:parquet 361654298 356903223 1.01
clickbench_q18/duckdb:parquet 700090165 689852321 1.01
clickbench_q19/duckdb:parquet 21128652 23121174 0.91
clickbench_q20/duckdb:parquet 270225607 263141686 1.03
clickbench_q21/duckdb:parquet 340382990 316581153 1.08
clickbench_q22/duckdb:parquet 482772153 461979004 1.05
clickbench_q23/duckdb:parquet 252259968 252181368 1.00
clickbench_q24/duckdb:parquet 71094048 66013892 1.08
clickbench_q25/duckdb:parquet 75631892 73040550 1.04
clickbench_q26/duckdb:parquet 47549026 46904716 1.01
clickbench_q27/duckdb:parquet 280126984 272360679 1.03
clickbench_q28/duckdb:parquet 1757326316 1699607875 1.03
clickbench_q29/duckdb:parquet 26932150 26988500 1.00
clickbench_q30/duckdb:parquet 179474604 177200545 1.01
clickbench_q31/duckdb:parquet 318527380 310201232 1.03
clickbench_q32/duckdb:parquet 925437670 912572372 1.01
clickbench_q33/duckdb:parquet 790719633 783883360 1.01
clickbench_q34/duckdb:parquet 801495330 798515554 1.00
clickbench_q35/duckdb:parquet 209287611 208389933 1.00
clickbench_q36/duckdb:parquet 50393335 50238241 1.00
clickbench_q37/duckdb:parquet 36748023 36806703 1.00
clickbench_q38/duckdb:parquet 40593964 39072510 1.04
clickbench_q39/duckdb:parquet 88321812 91137552 0.97
clickbench_q40/duckdb:parquet 20730225 20172693 1.03
clickbench_q41/duckdb:parquet 19103163 19546178 0.98
clickbench_q42/duckdb:parquet 23741274 23269735 1.02
File Size Changes (101 files changed, -60.8% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-file-compressed 89.98 MB 0 B 89.98 MB -100.0%
hits_1.vortex 1.0 vortex-file-compressed 138.88 MB 0 B 138.88 MB -100.0%
hits_10.vortex 1.0 vortex-file-compressed 69.58 MB 0 B 69.58 MB -100.0%
hits_11.vortex 1.0 vortex-file-compressed 80.00 MB 0 B 80.00 MB -100.0%
hits_12.vortex 1.0 vortex-file-compressed 101.33 MB 0 B 101.33 MB -100.0%
hits_13.vortex 1.0 vortex-file-compressed 99.65 MB 0 B 99.65 MB -100.0%
hits_14.vortex 1.0 vortex-file-compressed 111.63 MB 0 B 111.63 MB -100.0%
hits_15.vortex 1.0 vortex-file-compressed 89.27 MB 0 B 89.27 MB -100.0%
hits_16.vortex 1.0 vortex-file-compressed 79.46 MB 0 B 79.46 MB -100.0%
hits_17.vortex 1.0 vortex-file-compressed 87.59 MB 0 B 87.59 MB -100.0%
hits_18.vortex 1.0 vortex-file-compressed 104.87 MB 0 B 104.87 MB -100.0%
hits_19.vortex 1.0 vortex-file-compressed 73.36 MB 0 B 73.36 MB -100.0%
hits_2.vortex 1.0 vortex-file-compressed 187.07 MB 0 B 187.07 MB -100.0%
hits_20.vortex 1.0 vortex-file-compressed 62.65 MB 0 B 62.65 MB -100.0%
hits_21.vortex 1.0 vortex-file-compressed 93.14 MB 0 B 93.14 MB -100.0%
hits_22.vortex 1.0 vortex-file-compressed 77.08 MB 0 B 77.08 MB -100.0%
hits_23.vortex 1.0 vortex-file-compressed 76.50 MB 0 B 76.50 MB -100.0%
hits_24.vortex 1.0 vortex-file-compressed 76.01 MB 0 B 76.01 MB -100.0%
hits_25.vortex 1.0 vortex-file-compressed 113.80 MB 0 B 113.80 MB -100.0%
hits_26.vortex 1.0 vortex-file-compressed 109.79 MB 0 B 109.79 MB -100.0%
hits_27.vortex 1.0 vortex-file-compressed 123.30 MB 0 B 123.30 MB -100.0%
hits_28.vortex 1.0 vortex-file-compressed 120.53 MB 0 B 120.53 MB -100.0%
hits_29.vortex 1.0 vortex-file-compressed 59.54 MB 0 B 59.54 MB -100.0%
hits_3.vortex 1.0 vortex-file-compressed 142.57 MB 0 B 142.57 MB -100.0%
hits_30.vortex 1.0 vortex-file-compressed 87.19 MB 0 B 87.19 MB -100.0%
hits_31.vortex 1.0 vortex-file-compressed 90.32 MB 0 B 90.32 MB -100.0%
hits_32.vortex 1.0 vortex-file-compressed 66.83 MB 0 B 66.83 MB -100.0%
hits_33.vortex 1.0 vortex-file-compressed 57.18 MB 0 B 57.18 MB -100.0%
hits_34.vortex 1.0 vortex-file-compressed 97.86 MB 0 B 97.86 MB -100.0%
hits_35.vortex 1.0 vortex-file-compressed 115.52 MB 0 B 115.52 MB -100.0%
hits_36.vortex 1.0 vortex-file-compressed 68.60 MB 0 B 68.60 MB -100.0%
hits_37.vortex 1.0 vortex-file-compressed 85.67 MB 0 B 85.67 MB -100.0%
hits_38.vortex 1.0 vortex-file-compressed 99.37 MB 0 B 99.37 MB -100.0%
hits_39.vortex 1.0 vortex-file-compressed 80.39 MB 0 B 80.39 MB -100.0%
hits_4.vortex 1.0 vortex-file-compressed 109.09 MB 0 B 109.09 MB -100.0%
hits_40.vortex 1.0 vortex-file-compressed 118.09 MB 0 B 118.09 MB -100.0%
hits_41.vortex 1.0 vortex-file-compressed 224.38 MB 0 B 224.38 MB -100.0%
hits_42.vortex 1.0 vortex-file-compressed 223.25 MB 0 B 223.25 MB -100.0%
hits_43.vortex 1.0 vortex-file-compressed 227.72 MB 0 B 227.72 MB -100.0%
hits_44.vortex 1.0 vortex-file-compressed 186.89 MB 0 B 186.89 MB -100.0%
hits_45.vortex 1.0 vortex-file-compressed 122.43 MB 0 B 122.43 MB -100.0%
hits_46.vortex 1.0 vortex-file-compressed 69.35 MB 0 B 69.35 MB -100.0%
hits_47.vortex 1.0 vortex-file-compressed 41.25 MB 0 B 41.25 MB -100.0%
hits_48.vortex 1.0 vortex-file-compressed 28.03 MB 0 B 28.03 MB -100.0%
hits_49.vortex 1.0 vortex-file-compressed 75.73 MB 0 B 75.73 MB -100.0%
hits_5.vortex 1.0 vortex-file-compressed 93.70 MB 0 B 93.70 MB -100.0%
hits_50.vortex 1.0 vortex-file-compressed 180.37 MB 0 B 180.37 MB -100.0%
hits_51.vortex 1.0 vortex-file-compressed 280.34 MB 0 B 280.34 MB -100.0%
hits_52.vortex 1.0 vortex-file-compressed 103.90 MB 0 B 103.90 MB -100.0%
hits_53.vortex 1.0 vortex-file-compressed 85.82 MB 0 B 85.82 MB -100.0%
hits_54.vortex 1.0 vortex-file-compressed 223.19 MB 0 B 223.19 MB -100.0%
hits_55.vortex 1.0 vortex-file-compressed 170.19 MB 0 B 170.19 MB -100.0%
hits_56.vortex 1.0 vortex-file-compressed 124.03 MB 0 B 124.03 MB -100.0%
hits_57.vortex 1.0 vortex-file-compressed 128.67 MB 0 B 128.67 MB -100.0%
hits_58.vortex 1.0 vortex-file-compressed 90.80 MB 0 B 90.80 MB -100.0%
hits_59.vortex 1.0 vortex-file-compressed 102.04 MB 0 B 102.04 MB -100.0%
hits_6.vortex 1.0 vortex-file-compressed 94.07 MB 0 B 94.07 MB -100.0%
hits_60.vortex 1.0 vortex-file-compressed 103.57 MB 0 B 103.57 MB -100.0%
hits_61.vortex 1.0 vortex-file-compressed 101.41 MB 0 B 101.41 MB -100.0%
hits_62.vortex 1.0 vortex-file-compressed 117.79 MB 0 B 117.79 MB -100.0%
hits_63.vortex 1.0 vortex-file-compressed 69.27 MB 0 B 69.27 MB -100.0%
hits_64.vortex 1.0 vortex-file-compressed 81.22 MB 0 B 81.22 MB -100.0%
hits_65.vortex 1.0 vortex-file-compressed 184.41 MB 0 B 184.41 MB -100.0%
hits_66.vortex 1.0 vortex-file-compressed 90.40 MB 0 B 90.40 MB -100.0%
hits_67.vortex 1.0 vortex-file-compressed 185.41 MB 0 B 185.41 MB -100.0%
hits_68.vortex 1.0 vortex-file-compressed 123.50 MB 0 B 123.50 MB -100.0%
hits_69.vortex 1.0 vortex-file-compressed 123.48 MB 0 B 123.48 MB -100.0%
hits_7.vortex 1.0 vortex-file-compressed 94.72 MB 0 B 94.72 MB -100.0%
hits_70.vortex 1.0 vortex-file-compressed 93.93 MB 0 B 93.93 MB -100.0%
hits_71.vortex 1.0 vortex-file-compressed 102.16 MB 0 B 102.16 MB -100.0%
hits_72.vortex 1.0 vortex-file-compressed 84.69 MB 0 B 84.69 MB -100.0%
hits_73.vortex 1.0 vortex-file-compressed 109.92 MB 0 B 109.92 MB -100.0%
hits_74.vortex 1.0 vortex-file-compressed 120.18 MB 0 B 120.18 MB -100.0%
hits_75.vortex 1.0 vortex-file-compressed 63.49 MB 0 B 63.49 MB -100.0%
hits_76.vortex 1.0 vortex-file-compressed 114.35 MB 0 B 114.35 MB -100.0%
hits_77.vortex 1.0 vortex-file-compressed 169.01 MB 0 B 169.01 MB -100.0%
hits_78.vortex 1.0 vortex-file-compressed 165.52 MB 0 B 165.52 MB -100.0%
hits_79.vortex 1.0 vortex-file-compressed 144.84 MB 0 B 144.84 MB -100.0%
hits_8.vortex 1.0 vortex-file-compressed 93.98 MB 0 B 93.98 MB -100.0%
hits_80.vortex 1.0 vortex-file-compressed 105.48 MB 0 B 105.48 MB -100.0%
hits_81.vortex 1.0 vortex-file-compressed 101.36 MB 0 B 101.36 MB -100.0%
hits_82.vortex 1.0 vortex-file-compressed 99.99 MB 0 B 99.99 MB -100.0%
hits_83.vortex 1.0 vortex-file-compressed 89.42 MB 0 B 89.42 MB -100.0%
hits_84.vortex 1.0 vortex-file-compressed 117.86 MB 0 B 117.86 MB -100.0%
hits_85.vortex 1.0 vortex-file-compressed 91.80 MB 0 B 91.80 MB -100.0%
hits_86.vortex 1.0 vortex-file-compressed 69.42 MB 0 B 69.42 MB -100.0%
hits_87.vortex 1.0 vortex-file-compressed 173.03 MB 0 B 173.03 MB -100.0%
hits_88.vortex 1.0 vortex-file-compressed 111.37 MB 0 B 111.37 MB -100.0%
hits_89.vortex 1.0 vortex-file-compressed 185.66 MB 0 B 185.66 MB -100.0%
hits_9.vortex 1.0 vortex-file-compressed 99.71 MB 0 B 99.71 MB -100.0%
hits_90.vortex 1.0 vortex-file-compressed 142.88 MB 0 B 142.88 MB -100.0%
hits_91.vortex 1.0 vortex-file-compressed 97.36 MB 0 B 97.36 MB -100.0%
hits_92.vortex 1.0 vortex-file-compressed 147.51 MB 0 B 147.51 MB -100.0%
hits_93.vortex 1.0 vortex-file-compressed 90.68 MB 0 B 90.68 MB -100.0%
hits_94.vortex 1.0 vortex-file-compressed 139.39 MB 0 B 139.39 MB -100.0%
hits_95.vortex 1.0 vortex-file-compressed 96.47 MB 0 B 96.47 MB -100.0%
hits_96.vortex 1.0 vortex-file-compressed 136.17 MB 0 B 136.17 MB -100.0%
hits_97.vortex 1.0 vortex-file-compressed 107.27 MB 0 B 107.27 MB -100.0%
hits_98.vortex 1.0 vortex-file-compressed 118.90 MB 0 B 118.90 MB -100.0%
hits_99.vortex 1.0 vortex-file-compressed 123.59 MB 0 B 123.59 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 7.11 GB (0.0%)
  • vortex-file-compressed: 11.04 GB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.8%
Engines: DataFusion No clear signal (+10.0%, environment too noisy confidence) · DuckDB No clear signal (+1.6%, low confidence)
Vortex (geomean): 1.129x ➖
Parquet (geomean): 1.068x ➖
Shifts: Parquet (control) +6.8% · Median polish +8.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-compact / ns (1.256x ➖, 0↑ 4↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 52372442 36252542 1.44
fineweb_q01/datafusion:vortex-compact 🚨 641702152 417007822 1.54
fineweb_q02/datafusion:vortex-compact 🚨 752138571 550245519 1.37
fineweb_q03/datafusion:vortex-compact 968492556 851329922 1.14
fineweb_q04/datafusion:vortex-compact 771283985 743368202 1.04
fineweb_q05/datafusion:vortex-compact 708631286 642061964 1.10
fineweb_q06/datafusion:vortex-compact 897958961 755805171 1.19
fineweb_q07/datafusion:vortex-compact 718243449 689690877 1.04
fineweb_q08/datafusion:vortex-compact 🚨 402623379 253971258 1.59
datafusion / parquet / ns (1.141x ➖, 0↑ 2↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 679409901 618417562 1.10
fineweb_q01/datafusion:parquet 1152612184 971077654 1.19
fineweb_q02/datafusion:parquet 984266881 1009914775 0.97
fineweb_q03/datafusion:parquet 930457595 825464665 1.13
fineweb_q04/datafusion:parquet 984303388 908559456 1.08
fineweb_q05/datafusion:parquet 979088444 871777044 1.12
fineweb_q06/datafusion:parquet 🚨 1129327369 833239667 1.36
fineweb_q07/datafusion:parquet 🚨 1216654073 879443081 1.38
fineweb_q08/datafusion:parquet 965972950 962452141 1.00
duckdb / vortex-compact / ns (1.015x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 54254441 52148946 1.04
fineweb_q01/duckdb:vortex-compact 576162355 603351207 0.95
fineweb_q02/duckdb:vortex-compact 597471600 603084742 0.99
fineweb_q03/duckdb:vortex-compact 1615279347 1594888515 1.01
fineweb_q04/duckdb:vortex-compact 1748659089 1686269028 1.04
fineweb_q05/duckdb:vortex-compact 1635993930 1735066697 0.94
fineweb_q06/duckdb:vortex-compact 1692567238 1646511255 1.03
fineweb_q07/duckdb:vortex-compact 1578864354 1510857281 1.05
fineweb_q08/duckdb:vortex-compact 662735230 604659397 1.10
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 5265922583 5250555728 1.00
fineweb_q01/duckdb:parquet 5297681349 5316482314 1.00
fineweb_q02/duckdb:parquet 5350557347 5353213420 1.00
fineweb_q03/duckdb:parquet 5353570159 5370862675 1.00
fineweb_q04/duckdb:parquet 5297506694 5311070241 1.00
fineweb_q05/duckdb:parquet 5337660044 5307763594 1.01
fineweb_q06/duckdb:parquet 5378999668 5422725988 0.99
fineweb_q07/duckdb:parquet 5342488812 5340058417 1.00
fineweb_q08/duckdb:parquet 5261071243 5260022130 1.00

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-2.1%, environment too noisy confidence) · DuckDB No clear signal (+2.8%, low confidence)
Vortex (geomean): 1.019x ➖
Parquet (geomean): 1.016x ➖
Shifts: Parquet (control) +1.6% · Median polish +1.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 77e7bc2 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-compact 236568613 223782191 1.06
clickbench-sorted_q24/datafusion:vortex-compact 51105877 52151395 0.98
clickbench-sorted_q26/datafusion:vortex-compact 54122791 57268381 0.95
clickbench-sorted_q36/datafusion:vortex-compact 57301823 57771674 0.99
clickbench-sorted_q37/datafusion:vortex-compact 47751668 48296320 0.99
clickbench-sorted_q38/datafusion:vortex-compact 44040585 44620589 0.99
clickbench-sorted_q39/datafusion:vortex-compact 109945292 107555139 1.02
clickbench-sorted_q40/datafusion:vortex-compact 26648114 25419101 1.05
clickbench-sorted_q41/datafusion:vortex-compact 22096960 22322237 0.99
clickbench-sorted_q42/datafusion:vortex-compact 15503191 15183940 1.02
datafusion / parquet / ns (1.024x ➖, 1↑ 1↓)
name PR 34d36b1 (ns) base 77e7bc2 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 2900821539 2908812658 1.00
clickbench-sorted_q24/datafusion:parquet 31920745 30567864 1.04
clickbench-sorted_q26/datafusion:parquet 🚨 48147122 34108087 1.41
clickbench-sorted_q36/datafusion:parquet 168292948 177782689 0.95
clickbench-sorted_q37/datafusion:parquet 110218466 101394582 1.09
clickbench-sorted_q38/datafusion:parquet 169256162 164993458 1.03
clickbench-sorted_q39/datafusion:parquet 307633147 319891233 0.96
clickbench-sorted_q40/datafusion:parquet 🚀 66088895 76897147 0.86
clickbench-sorted_q41/datafusion:parquet 59587317 59880532 1.00
clickbench-sorted_q42/datafusion:parquet 34591838 34681239 1.00
duckdb / vortex-compact / ns (1.037x ➖, 1↑ 3↓)
name PR 34d36b1 (ns) base 77e7bc2 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-compact 🚨 292143923 217965047 1.34
clickbench-sorted_q24/duckdb:vortex-compact 65803479 66222881 0.99
clickbench-sorted_q26/duckdb:vortex-compact 🚨 87732667 70775259 1.24
clickbench-sorted_q36/duckdb:vortex-compact 🚨 74243310 67268366 1.10
clickbench-sorted_q37/duckdb:vortex-compact 59830891 59102341 1.01
clickbench-sorted_q38/duckdb:vortex-compact 63685620 65954256 0.97
clickbench-sorted_q39/duckdb:vortex-compact 117649304 118356620 0.99
clickbench-sorted_q40/duckdb:vortex-compact 42468243 41952576 1.01
clickbench-sorted_q41/duckdb:vortex-compact 🚀 37613651 42481621 0.89
clickbench-sorted_q42/duckdb:vortex-compact 29999402 33221857 0.90
duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 77e7bc2 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 221905046 217932392 1.02
clickbench-sorted_q24/duckdb:parquet 31507135 29279101 1.08
clickbench-sorted_q26/duckdb:parquet 22756761 23828557 0.96
clickbench-sorted_q36/duckdb:parquet 71319159 69008356 1.03
clickbench-sorted_q37/duckdb:parquet 60685827 59413498 1.02
clickbench-sorted_q38/duckdb:parquet 60069729 61254915 0.98
clickbench-sorted_q39/duckdb:parquet 109751529 109234701 1.00
clickbench-sorted_q40/duckdb:parquet 30121861 29950261 1.01
clickbench-sorted_q41/duckdb:parquet 29083429 29050812 1.00
clickbench-sorted_q42/duckdb:parquet 19779696 19895418 0.99
File Size Changes (201 files changed, -57.2% overall, 53↑ 148↓)
File Scale Format Base HEAD Change %
hits_098.vortex 1.0 vortex-compact 102.60 MB 104.26 MB +1.66 MB +1.6%
hits_024.vortex 1.0 vortex-compact 123.85 MB 125.15 MB +1.30 MB +1.0%
hits_063.vortex 1.0 vortex-compact 98.17 MB 99.17 MB +1017.66 KB +1.0%
hits_075.vortex 1.0 vortex-compact 137.84 MB 139.15 MB +1.31 MB +0.9%
hits_097.vortex 1.0 vortex-compact 140.16 MB 141.31 MB +1.14 MB +0.8%
hits_084.vortex 1.0 vortex-compact 110.72 MB 111.40 MB +693.23 KB +0.6%
hits_015.vortex 1.0 vortex-compact 97.69 MB 98.24 MB +560.39 KB +0.6%
hits_033.vortex 1.0 vortex-compact 152.88 MB 153.66 MB +799.80 KB +0.5%
hits_031.vortex 1.0 vortex-compact 111.18 MB 111.67 MB +508.28 KB +0.4%
hits_021.vortex 1.0 vortex-compact 110.64 MB 111.13 MB +502.89 KB +0.4%
hits_008.vortex 1.0 vortex-compact 105.67 MB 106.13 MB +472.05 KB +0.4%
hits_017.vortex 1.0 vortex-compact 111.74 MB 112.22 MB +492.48 KB +0.4%
hits_019.vortex 1.0 vortex-compact 106.22 MB 106.67 MB +453.90 KB +0.4%
hits_065.vortex 1.0 vortex-compact 125.39 MB 125.88 MB +497.34 KB +0.4%
hits_041.vortex 1.0 vortex-compact 97.76 MB 98.13 MB +380.81 KB +0.4%
hits_006.vortex 1.0 vortex-compact 96.07 MB 96.42 MB +361.48 KB +0.4%
hits_010.vortex 1.0 vortex-compact 123.17 MB 123.61 MB +454.95 KB +0.4%
hits_052.vortex 1.0 vortex-compact 98.33 MB 98.63 MB +307.43 KB +0.3%
hits_088.vortex 1.0 vortex-compact 134.10 MB 134.44 MB +354.27 KB +0.3%
hits_081.vortex 1.0 vortex-compact 153.40 MB 153.74 MB +351.40 KB +0.2%
hits_029.vortex 1.0 vortex-compact 153.31 MB 153.64 MB +334.10 KB +0.2%
hits_045.vortex 1.0 vortex-compact 105.85 MB 106.07 MB +230.37 KB +0.2%
hits_014.vortex 1.0 vortex-compact 133.82 MB 134.09 MB +277.34 KB +0.2%
hits_039.vortex 1.0 vortex-compact 124.35 MB 124.56 MB +218.69 KB +0.2%
hits_089.vortex 1.0 vortex-compact 98.65 MB 98.80 MB +151.20 KB +0.1%
hits_074.vortex 1.0 vortex-compact 152.95 MB 153.14 MB +203.66 KB +0.1%
hits_070.vortex 1.0 vortex-compact 153.68 MB 153.88 MB +203.33 KB +0.1%
hits_066.vortex 1.0 vortex-compact 117.46 MB 117.60 MB +143.64 KB +0.1%
hits_012.vortex 1.0 vortex-compact 139.90 MB 140.06 MB +167.24 KB +0.1%
hits_011.vortex 1.0 vortex-compact 152.63 MB 152.81 MB +181.77 KB +0.1%
hits_027.vortex 1.0 vortex-compact 139.24 MB 139.38 MB +143.97 KB +0.1%
hits_034.vortex 1.0 vortex-compact 133.37 MB 133.50 MB +134.23 KB +0.1%
hits_083.vortex 1.0 vortex-compact 110.01 MB 110.11 MB +108.80 KB +0.1%
hits_050.vortex 1.0 vortex-compact 125.40 MB 125.52 MB +123.56 KB +0.1%
hits_073.vortex 1.0 vortex-compact 134.31 MB 134.44 MB +126.98 KB +0.1%
hits_055.vortex 1.0 vortex-compact 153.27 MB 153.39 MB +117.88 KB +0.1%
hits_079.vortex 1.0 vortex-compact 127.99 MB 128.08 MB +95.16 KB +0.1%
hits_057.vortex 1.0 vortex-compact 111.83 MB 111.91 MB +82.44 KB +0.1%
hits_096.vortex 1.0 vortex-compact 153.14 MB 153.24 MB +101.68 KB +0.1%
hits_099.vortex 1.0 vortex-compact 133.08 MB 133.16 MB +77.85 KB +0.1%
hits_058.vortex 1.0 vortex-compact 111.08 MB 111.14 MB +56.70 KB +0.0%
hits_069.vortex 1.0 vortex-compact 100.08 MB 100.12 MB +45.63 KB +0.0%
hits_042.vortex 1.0 vortex-compact 136.27 MB 136.32 MB +49.67 KB +0.0%
hits_095.vortex 1.0 vortex-compact 110.65 MB 110.69 MB +40.09 KB +0.0%
hits_062.vortex 1.0 vortex-compact 132.57 MB 132.62 MB +43.99 KB +0.0%
hits_047.vortex 1.0 vortex-compact 110.48 MB 110.51 MB +31.90 KB +0.0%
hits_016.vortex 1.0 vortex-compact 127.40 MB 127.43 MB +26.88 KB +0.0%
hits_072.vortex 1.0 vortex-compact 75.62 MB 75.64 MB +13.88 KB +0.0%
hits_085.vortex 1.0 vortex-compact 153.46 MB 153.49 MB +25.00 KB +0.0%
hits_056.vortex 1.0 vortex-compact 101.33 MB 101.35 MB +12.18 KB +0.0%
hits_048.vortex 1.0 vortex-compact 153.39 MB 153.40 MB +8.97 KB +0.0%
hits_064.vortex 1.0 vortex-compact 140.03 MB 140.04 MB +7.65 KB +0.0%
hits_092.vortex 1.0 vortex-compact 153.40 MB 153.40 MB +3.68 KB +0.0%
hits_009.vortex 1.0 vortex-compact 75.23 MB 75.23 MB 488 B -0.0%
hits_094.vortex 1.0 vortex-compact 110.74 MB 110.74 MB 1.12 KB -0.0%
hits_022.vortex 1.0 vortex-compact 153.08 MB 153.08 MB 1.95 KB -0.0%
hits_002.vortex 1.0 vortex-compact 124.15 MB 124.15 MB 1.61 KB -0.0%
hits_032.vortex 1.0 vortex-compact 110.62 MB 110.62 MB 1.89 KB -0.0%
hits_018.vortex 1.0 vortex-compact 153.70 MB 153.70 MB 4.12 KB -0.0%
hits_035.vortex 1.0 vortex-compact 75.97 MB 75.97 MB 2.22 KB -0.0%
hits_023.vortex 1.0 vortex-compact 142.73 MB 142.72 MB 8.91 KB -0.0%
hits_086.vortex 1.0 vortex-compact 140.82 MB 140.81 MB 11.07 KB -0.0%
hits_046.vortex 1.0 vortex-compact 74.94 MB 74.93 MB 8.86 KB -0.0%
hits_028.vortex 1.0 vortex-compact 115.70 MB 115.68 MB 16.02 KB -0.0%
hits_090.vortex 1.0 vortex-compact 141.37 MB 141.35 MB 20.39 KB -0.0%
hits_005.vortex 1.0 vortex-compact 115.89 MB 115.87 MB 18.93 KB -0.0%
hits_043.vortex 1.0 vortex-compact 94.35 MB 94.34 MB 19.36 KB -0.0%
hits_003.vortex 1.0 vortex-compact 104.55 MB 104.53 MB 21.84 KB -0.0%
hits_036.vortex 1.0 vortex-compact 133.41 MB 133.37 MB 32.98 KB -0.0%
hits_044.vortex 1.0 vortex-compact 153.78 MB 153.74 MB 44.16 KB -0.0%
hits_060.vortex 1.0 vortex-compact 141.21 MB 141.15 MB 62.16 KB -0.0%
hits_040.vortex 1.0 vortex-compact 110.08 MB 110.03 MB 56.86 KB -0.1%
hits_071.vortex 1.0 vortex-compact 105.82 MB 105.76 MB 62.02 KB -0.1%
hits_053.vortex 1.0 vortex-compact 138.56 MB 138.46 MB 100.98 KB -0.1%
hits_068.vortex 1.0 vortex-compact 112.55 MB 112.47 MB 83.83 KB -0.1%
hits_087.vortex 1.0 vortex-compact 125.17 MB 125.08 MB 96.17 KB -0.1%
hits_038.vortex 1.0 vortex-compact 139.60 MB 139.48 MB 116.90 KB -0.1%
hits_051.vortex 1.0 vortex-compact 133.99 MB 133.85 MB 146.05 KB -0.1%
hits_013.vortex 1.0 vortex-compact 125.86 MB 125.72 MB 143.08 KB -0.1%
hits_007.vortex 1.0 vortex-compact 153.75 MB 153.57 MB 181.92 KB -0.1%
hits_000.vortex 1.0 vortex-compact 98.69 MB 98.57 MB 126.11 KB -0.1%
hits_077.vortex 1.0 vortex-compact 134.32 MB 134.14 MB 178.82 KB -0.1%
hits_026.vortex 1.0 vortex-compact 98.28 MB 98.14 MB 143.07 KB -0.1%
hits_020.vortex 1.0 vortex-compact 111.92 MB 111.71 MB 210.70 KB -0.2%
hits_025.vortex 1.0 vortex-compact 133.68 MB 133.40 MB 288.20 KB -0.2%
hits_037.vortex 1.0 vortex-compact 132.65 MB 132.30 MB 365.04 KB -0.3%
hits_059.vortex 1.0 vortex-compact 153.12 MB 152.71 MB 426.46 KB -0.3%
hits_061.vortex 1.0 vortex-compact 123.90 MB 123.43 MB 475.81 KB -0.4%
hits_054.vortex 1.0 vortex-compact 112.12 MB 111.65 MB 490.14 KB -0.4%
hits_082.vortex 1.0 vortex-compact 106.23 MB 105.76 MB 483.55 KB -0.4%
hits_049.vortex 1.0 vortex-compact 141.12 MB 140.48 MB 653.02 KB -0.5%
hits_080.vortex 1.0 vortex-compact 97.10 MB 96.65 MB 463.56 KB -0.5%
hits_067.vortex 1.0 vortex-compact 99.90 MB 99.44 MB 478.23 KB -0.5%
hits_091.vortex 1.0 vortex-compact 112.30 MB 111.68 MB 640.19 KB -0.6%
hits_093.vortex 1.0 vortex-compact 98.45 MB 97.85 MB 618.26 KB -0.6%
hits_078.vortex 1.0 vortex-compact 97.84 MB 97.17 MB 685.12 KB -0.7%
hits_076.vortex 1.0 vortex-compact 126.13 MB 125.25 MB 904.84 KB -0.7%
hits_004.vortex 1.0 vortex-compact 98.16 MB 97.34 MB 837.30 KB -0.8%
hits_001.vortex 1.0 vortex-compact 140.34 MB 139.00 MB 1.34 MB -1.0%
hits_030.vortex 1.0 vortex-compact 99.16 MB 97.74 MB 1.42 MB -1.4%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-file-compressed 131.88 MB 0 B 131.88 MB -100.0%
hits_001.vortex 1.0 vortex-file-compressed 193.44 MB 0 B 193.44 MB -100.0%
hits_002.vortex 1.0 vortex-file-compressed 159.59 MB 0 B 159.59 MB -100.0%
hits_003.vortex 1.0 vortex-file-compressed 136.61 MB 0 B 136.61 MB -100.0%
hits_004.vortex 1.0 vortex-file-compressed 131.75 MB 0 B 131.75 MB -100.0%
hits_005.vortex 1.0 vortex-file-compressed 167.59 MB 0 B 167.59 MB -100.0%
hits_006.vortex 1.0 vortex-file-compressed 126.40 MB 0 B 126.40 MB -100.0%
hits_007.vortex 1.0 vortex-file-compressed 200.18 MB 0 B 200.18 MB -100.0%
hits_008.vortex 1.0 vortex-file-compressed 140.33 MB 0 B 140.33 MB -100.0%
hits_009.vortex 1.0 vortex-file-compressed 101.41 MB 0 B 101.41 MB -100.0%
hits_010.vortex 1.0 vortex-file-compressed 169.69 MB 0 B 169.69 MB -100.0%
hits_011.vortex 1.0 vortex-file-compressed 199.25 MB 0 B 199.25 MB -100.0%
hits_012.vortex 1.0 vortex-file-compressed 190.79 MB 0 B 190.79 MB -100.0%
hits_013.vortex 1.0 vortex-file-compressed 161.78 MB 0 B 161.78 MB -100.0%
hits_014.vortex 1.0 vortex-file-compressed 172.07 MB 0 B 172.07 MB -100.0%
hits_015.vortex 1.0 vortex-file-compressed 131.50 MB 0 B 131.50 MB -100.0%
hits_016.vortex 1.0 vortex-file-compressed 180.25 MB 0 B 180.25 MB -100.0%
hits_017.vortex 1.0 vortex-file-compressed 146.87 MB 0 B 146.87 MB -100.0%
hits_018.vortex 1.0 vortex-file-compressed 198.54 MB 0 B 198.54 MB -100.0%
hits_019.vortex 1.0 vortex-file-compressed 140.84 MB 0 B 140.84 MB -100.0%
hits_020.vortex 1.0 vortex-file-compressed 160.54 MB 0 B 160.54 MB -100.0%
hits_021.vortex 1.0 vortex-file-compressed 154.35 MB 0 B 154.35 MB -100.0%
hits_022.vortex 1.0 vortex-file-compressed 198.97 MB 0 B 198.97 MB -100.0%
hits_023.vortex 1.0 vortex-file-compressed 197.31 MB 0 B 197.31 MB -100.0%
hits_024.vortex 1.0 vortex-file-compressed 160.55 MB 0 B 160.55 MB -100.0%
hits_025.vortex 1.0 vortex-file-compressed 172.11 MB 0 B 172.11 MB -100.0%
hits_026.vortex 1.0 vortex-file-compressed 131.36 MB 0 B 131.36 MB -100.0%
hits_027.vortex 1.0 vortex-file-compressed 192.13 MB 0 B 192.13 MB -100.0%
hits_028.vortex 1.0 vortex-file-compressed 151.80 MB 0 B 151.80 MB -100.0%
hits_029.vortex 1.0 vortex-file-compressed 199.91 MB 0 B 199.91 MB -100.0%
hits_030.vortex 1.0 vortex-file-compressed 131.78 MB 0 B 131.78 MB -100.0%
hits_031.vortex 1.0 vortex-file-compressed 159.88 MB 0 B 159.88 MB -100.0%
hits_032.vortex 1.0 vortex-file-compressed 154.79 MB 0 B 154.79 MB -100.0%
hits_033.vortex 1.0 vortex-file-compressed 200.25 MB 0 B 200.25 MB -100.0%
hits_034.vortex 1.0 vortex-file-compressed 182.06 MB 0 B 182.06 MB -100.0%
hits_035.vortex 1.0 vortex-file-compressed 103.05 MB 0 B 103.05 MB -100.0%
hits_036.vortex 1.0 vortex-file-compressed 171.38 MB 0 B 171.38 MB -100.0%
hits_037.vortex 1.0 vortex-file-compressed 177.41 MB 0 B 177.41 MB -100.0%
hits_038.vortex 1.0 vortex-file-compressed 190.21 MB 0 B 190.21 MB -100.0%
hits_039.vortex 1.0 vortex-file-compressed 160.92 MB 0 B 160.92 MB -100.0%
hits_040.vortex 1.0 vortex-file-compressed 143.03 MB 0 B 143.03 MB -100.0%
hits_041.vortex 1.0 vortex-file-compressed 131.29 MB 0 B 131.29 MB -100.0%
hits_042.vortex 1.0 vortex-file-compressed 201.59 MB 0 B 201.59 MB -100.0%
hits_043.vortex 1.0 vortex-file-compressed 126.53 MB 0 B 126.53 MB -100.0%
hits_044.vortex 1.0 vortex-file-compressed 200.34 MB 0 B 200.34 MB -100.0%
hits_045.vortex 1.0 vortex-file-compressed 141.11 MB 0 B 141.11 MB -100.0%
hits_046.vortex 1.0 vortex-file-compressed 101.25 MB 0 B 101.25 MB -100.0%
hits_047.vortex 1.0 vortex-file-compressed 154.38 MB 0 B 154.38 MB -100.0%
hits_048.vortex 1.0 vortex-file-compressed 199.61 MB 0 B 199.61 MB -100.0%
hits_049.vortex 1.0 vortex-file-compressed 191.44 MB 0 B 191.44 MB -100.0%
hits_050.vortex 1.0 vortex-file-compressed 161.02 MB 0 B 161.02 MB -100.0%
hits_051.vortex 1.0 vortex-file-compressed 172.31 MB 0 B 172.31 MB -100.0%
hits_052.vortex 1.0 vortex-file-compressed 131.02 MB 0 B 131.02 MB -100.0%
hits_053.vortex 1.0 vortex-file-compressed 190.00 MB 0 B 190.00 MB -100.0%
hits_054.vortex 1.0 vortex-file-compressed 147.12 MB 0 B 147.12 MB -100.0%
hits_055.vortex 1.0 vortex-file-compressed 199.97 MB 0 B 199.97 MB -100.0%
hits_056.vortex 1.0 vortex-file-compressed 136.48 MB 0 B 136.48 MB -100.0%
hits_057.vortex 1.0 vortex-file-compressed 160.40 MB 0 B 160.40 MB -100.0%
hits_058.vortex 1.0 vortex-file-compressed 155.55 MB 0 B 155.55 MB -100.0%
hits_059.vortex 1.0 vortex-file-compressed 198.97 MB 0 B 198.97 MB -100.0%
hits_060.vortex 1.0 vortex-file-compressed 193.20 MB 0 B 193.20 MB -100.0%
hits_061.vortex 1.0 vortex-file-compressed 160.81 MB 0 B 160.81 MB -100.0%
hits_062.vortex 1.0 vortex-file-compressed 171.20 MB 0 B 171.20 MB -100.0%
hits_063.vortex 1.0 vortex-file-compressed 131.66 MB 0 B 131.66 MB -100.0%
hits_064.vortex 1.0 vortex-file-compressed 190.99 MB 0 B 190.99 MB -100.0%
hits_065.vortex 1.0 vortex-file-compressed 161.93 MB 0 B 161.93 MB -100.0%
hits_066.vortex 1.0 vortex-file-compressed 163.31 MB 0 B 163.31 MB -100.0%
hits_067.vortex 1.0 vortex-file-compressed 131.72 MB 0 B 131.72 MB -100.0%
hits_068.vortex 1.0 vortex-file-compressed 161.12 MB 0 B 161.12 MB -100.0%
hits_069.vortex 1.0 vortex-file-compressed 142.26 MB 0 B 142.26 MB -100.0%
hits_070.vortex 1.0 vortex-file-compressed 199.83 MB 0 B 199.83 MB -100.0%
hits_071.vortex 1.0 vortex-file-compressed 140.14 MB 0 B 140.14 MB -100.0%
hits_072.vortex 1.0 vortex-file-compressed 102.30 MB 0 B 102.30 MB -100.0%
hits_073.vortex 1.0 vortex-file-compressed 172.67 MB 0 B 172.67 MB -100.0%
hits_074.vortex 1.0 vortex-file-compressed 199.25 MB 0 B 199.25 MB -100.0%
hits_075.vortex 1.0 vortex-file-compressed 189.49 MB 0 B 189.49 MB -100.0%
hits_076.vortex 1.0 vortex-file-compressed 160.91 MB 0 B 160.91 MB -100.0%
hits_077.vortex 1.0 vortex-file-compressed 172.48 MB 0 B 172.48 MB -100.0%
hits_078.vortex 1.0 vortex-file-compressed 131.15 MB 0 B 131.15 MB -100.0%
hits_079.vortex 1.0 vortex-file-compressed 181.47 MB 0 B 181.47 MB -100.0%
hits_080.vortex 1.0 vortex-file-compressed 126.95 MB 0 B 126.95 MB -100.0%
hits_081.vortex 1.0 vortex-file-compressed 199.97 MB 0 B 199.97 MB -100.0%
hits_082.vortex 1.0 vortex-file-compressed 141.20 MB 0 B 141.20 MB -100.0%
hits_083.vortex 1.0 vortex-file-compressed 157.19 MB 0 B 157.19 MB -100.0%
hits_084.vortex 1.0 vortex-file-compressed 154.59 MB 0 B 154.59 MB -100.0%
hits_085.vortex 1.0 vortex-file-compressed 199.71 MB 0 B 199.71 MB -100.0%
hits_086.vortex 1.0 vortex-file-compressed 192.20 MB 0 B 192.20 MB -100.0%
hits_087.vortex 1.0 vortex-file-compressed 161.06 MB 0 B 161.06 MB -100.0%
hits_088.vortex 1.0 vortex-file-compressed 172.74 MB 0 B 172.74 MB -100.0%
hits_089.vortex 1.0 vortex-file-compressed 131.51 MB 0 B 131.51 MB -100.0%
hits_090.vortex 1.0 vortex-file-compressed 192.68 MB 0 B 192.68 MB -100.0%
hits_091.vortex 1.0 vortex-file-compressed 147.28 MB 0 B 147.28 MB -100.0%
hits_092.vortex 1.0 vortex-file-compressed 199.48 MB 0 B 199.48 MB -100.0%
hits_093.vortex 1.0 vortex-file-compressed 131.75 MB 0 B 131.75 MB -100.0%
hits_094.vortex 1.0 vortex-file-compressed 158.65 MB 0 B 158.65 MB -100.0%
hits_095.vortex 1.0 vortex-file-compressed 154.37 MB 0 B 154.37 MB -100.0%
hits_096.vortex 1.0 vortex-file-compressed 199.54 MB 0 B 199.54 MB -100.0%
hits_097.vortex 1.0 vortex-file-compressed 192.92 MB 0 B 192.92 MB -100.0%
hits_098.vortex 1.0 vortex-file-compressed 138.14 MB 0 B 138.14 MB -100.0%
hits_099.vortex 1.0 vortex-file-compressed 171.39 MB 0 B 171.39 MB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 11.94 GB (+0.0%)
  • vortex-file-compressed: 15.97 GB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.0%
Engines: DataFusion No clear signal (+12.8%, environment too noisy confidence) · DuckDB No clear signal (+7.1%, environment too noisy confidence)
Vortex (geomean): 1.089x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish +4.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-compact / ns (1.060x ➖, 0↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 251805333 249743612 1.01
tpch_q02/datafusion:vortex-compact 432319017 473939397 0.91
tpch_q03/datafusion:vortex-compact 374283236 362794975 1.03
tpch_q04/datafusion:vortex-compact 198128409 158680711 1.25
tpch_q05/datafusion:vortex-compact 382635411 340878915 1.12
tpch_q06/datafusion:vortex-compact 283944128 259337089 1.09
tpch_q07/datafusion:vortex-compact 🚨 460310215 345512643 1.33
tpch_q08/datafusion:vortex-compact 456840978 470323007 0.97
tpch_q09/datafusion:vortex-compact 319096706 315568161 1.01
tpch_q10/datafusion:vortex-compact 346223962 337328151 1.03
tpch_q11/datafusion:vortex-compact 308089936 287700528 1.07
tpch_q12/datafusion:vortex-compact 430079948 369531096 1.16
tpch_q13/datafusion:vortex-compact 114078831 116374297 0.98
tpch_q14/datafusion:vortex-compact 204007977 192275409 1.06
tpch_q15/datafusion:vortex-compact 316613150 311412277 1.02
tpch_q16/datafusion:vortex-compact 195029458 193786708 1.01
tpch_q17/datafusion:vortex-compact 325696496 300299592 1.08
tpch_q18/datafusion:vortex-compact 257718547 224497524 1.15
tpch_q19/datafusion:vortex-compact 485454322 458512893 1.06
tpch_q20/datafusion:vortex-compact 358302615 336834290 1.06
tpch_q21/datafusion:vortex-compact 462866751 473987846 0.98
tpch_q22/datafusion:vortex-compact 160488946 157099268 1.02
datafusion / parquet / ns (0.940x ➖, 1↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 214204934 228593349 0.94
tpch_q02/datafusion:parquet 280579223 314225398 0.89
tpch_q03/datafusion:parquet 339385223 349308207 0.97
tpch_q04/datafusion:parquet 175548069 175433869 1.00
tpch_q05/datafusion:parquet 390551246 482717389 0.81
tpch_q06/datafusion:parquet 🚀 147798064 233136290 0.63
tpch_q07/datafusion:parquet 383255079 414226630 0.93
tpch_q08/datafusion:parquet 437979780 475929061 0.92
tpch_q09/datafusion:parquet 492984323 460322233 1.07
tpch_q10/datafusion:parquet 435958300 426686557 1.02
tpch_q11/datafusion:parquet 280079291 283810129 0.99
tpch_q12/datafusion:parquet 236323711 218681919 1.08
tpch_q13/datafusion:parquet 459151161 457887715 1.00
tpch_q14/datafusion:parquet 182078493 191388905 0.95
tpch_q15/datafusion:parquet 297359688 313676498 0.95
tpch_q16/datafusion:parquet 126506620 150245027 0.84
tpch_q17/datafusion:parquet 322030481 343690783 0.94
tpch_q18/datafusion:parquet 465084986 486653797 0.96
tpch_q19/datafusion:parquet 196829699 201061906 0.98
tpch_q20/datafusion:parquet 281943829 288366046 0.98
tpch_q21/datafusion:parquet 450442463 447234461 1.01
tpch_q22/datafusion:parquet 196007975 210233291 0.93
duckdb / vortex-compact / ns (1.118x ➖, 0↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 281348847 238374830 1.18
tpch_q02/duckdb:vortex-compact 670292937 608200262 1.10
tpch_q03/duckdb:vortex-compact 477977786 463862823 1.03
tpch_q04/duckdb:vortex-compact 332332073 268038540 1.24
tpch_q05/duckdb:vortex-compact 576422151 500942524 1.15
tpch_q06/duckdb:vortex-compact 326938099 276061579 1.18
tpch_q07/duckdb:vortex-compact 595516694 578670852 1.03
tpch_q08/duckdb:vortex-compact 750728366 779893031 0.96
tpch_q09/duckdb:vortex-compact 592955517 640154674 0.93
tpch_q10/duckdb:vortex-compact 542776955 468964066 1.16
tpch_q11/duckdb:vortex-compact 270101507 265237030 1.02
tpch_q12/duckdb:vortex-compact 494364374 398548157 1.24
tpch_q13/duckdb:vortex-compact 313067295 259800014 1.21
tpch_q14/duckdb:vortex-compact 326648517 253837436 1.29
tpch_q15/duckdb:vortex-compact 216561546 180834473 1.20
tpch_q16/duckdb:vortex-compact 239172440 227345630 1.05
tpch_q17/duckdb:vortex-compact 514271410 479577798 1.07
tpch_q18/duckdb:vortex-compact 437719500 436574734 1.00
tpch_q19/duckdb:vortex-compact 409927877 385187341 1.06
tpch_q20/duckdb:vortex-compact 522912576 512371205 1.02
tpch_q21/duckdb:vortex-compact 825781913 729212365 1.13
tpch_q22/duckdb:vortex-compact 🚨 229627787 154033432 1.49
duckdb / parquet / ns (1.044x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 436536032 338336176 1.29
tpch_q02/duckdb:parquet 672154123 683154816 0.98
tpch_q03/duckdb:parquet 783832771 861257877 0.91
tpch_q04/duckdb:parquet 509725881 475607610 1.07
tpch_q05/duckdb:parquet 1046312125 973363473 1.07
tpch_q06/duckdb:parquet 315917557 312210562 1.01
tpch_q07/duckdb:parquet 926981505 909760376 1.02
tpch_q08/duckdb:parquet 1196011338 1164649595 1.03
tpch_q09/duckdb:parquet 1094383415 1110793335 0.99
tpch_q10/duckdb:parquet 1104351919 1083231900 1.02
tpch_q11/duckdb:parquet 469816299 470146466 1.00
tpch_q12/duckdb:parquet 582275209 563829165 1.03
tpch_q13/duckdb:parquet 863624515 863577918 1.00
tpch_q14/duckdb:parquet 574414237 521228110 1.10
tpch_q15/duckdb:parquet 452245318 399149146 1.13
tpch_q16/duckdb:parquet 584957022 518182722 1.13
tpch_q17/duckdb:parquet 509153460 511109032 1.00
tpch_q18/duckdb:parquet 679767331 674106782 1.01
tpch_q19/duckdb:parquet 619295423 630713050 0.98
tpch_q20/duckdb:parquet 991647872 860539135 1.15
tpch_q21/duckdb:parquet 797410936 756904802 1.05
tpch_q22/duckdb:parquet 473040976 455221658 1.04

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+1.2%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): 1.006x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-compact / ns (1.005x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 77e7bc2 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-compact 102594610 101632053 1.01
appian_q02/datafusion:vortex-compact 476118648 471577392 1.01
appian_q03/datafusion:vortex-compact 282251650 280291213 1.01
appian_q04/datafusion:vortex-compact 13562492552 13600464683 1.00
appian_q05/datafusion:vortex-compact 224820262 227145875 0.99
appian_q06/datafusion:vortex-compact 278691528 273985241 1.02
appian_q07/datafusion:vortex-compact 358985461 359903641 1.00
appian_q08/datafusion:vortex-compact 1422656154 1408940471 1.01
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 77e7bc2 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 134228615 133318750 1.01
appian_q02/datafusion:parquet 590548934 593883840 0.99
appian_q03/datafusion:parquet 310629030 319032765 0.97
appian_q04/datafusion:parquet 13660457909 13639012327 1.00
appian_q05/datafusion:parquet 311569336 313601685 0.99
appian_q06/datafusion:parquet 304195557 309049399 0.98
appian_q07/datafusion:parquet 431483574 433997279 0.99
appian_q08/datafusion:parquet 1547274037 1558127380 0.99
duckdb / vortex-compact / ns (1.007x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 77e7bc2 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-compact 159743664 155114080 1.03
appian_q02/duckdb:vortex-compact 418656456 403466104 1.04
appian_q03/duckdb:vortex-compact 260292305 260606054 1.00
appian_q04/duckdb:vortex-compact 1588613080 1581371617 1.00
appian_q05/duckdb:vortex-compact 249626552 250006866 1.00
appian_q06/duckdb:vortex-compact 1005466172 1027502175 0.98
appian_q07/duckdb:vortex-compact 293576447 296386486 0.99
appian_q08/duckdb:vortex-compact 935042121 920388191 1.02
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 77e7bc2 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 157972258 155608496 1.02
appian_q02/duckdb:parquet 361515064 361265851 1.00
appian_q03/duckdb:parquet 220446613 221165315 1.00
appian_q04/duckdb:parquet 1472304714 1485520633 0.99
appian_q05/duckdb:parquet 245094360 244873784 1.00
appian_q06/duckdb:parquet 968932264 970692997 1.00
appian_q07/duckdb:parquet 267647895 266177522 1.01
appian_q08/duckdb:parquet 777093464 776431812 1.00
File Size Changes (10 files changed, -63.8% overall, 0↑ 10↓)
File Scale Format Base HEAD Change %
addressview.vortex 1.0 vortex-file-compressed 34.61 MB 0 B 34.61 MB -100.0%
categoryview.vortex 1.0 vortex-file-compressed 19.91 KB 0 B 19.91 KB -100.0%
creditcardview.vortex 1.0 vortex-file-compressed 59.15 MB 0 B 59.15 MB -100.0%
customerview.vortex 1.0 vortex-file-compressed 19.98 MB 0 B 19.98 MB -100.0%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
orderitemnovelty_update.vortex 1.0 vortex-file-compressed 11.95 KB 0 B 11.95 KB -100.0%
orderitemview.vortex 1.0 vortex-file-compressed 265.21 MB 0 B 265.21 MB -100.0%
orderview.vortex 1.0 vortex-file-compressed 78.51 MB 0 B 78.51 MB -100.0%
productview.vortex 1.0 vortex-file-compressed 19.78 KB 0 B 19.78 KB -100.0%
taxrecordview.vortex 1.0 vortex-file-compressed 21.91 MB 0 B 21.91 MB -100.0%

Totals:

  • vortex-compact: 271.91 MB → 271.91 MB (0.0%)
  • vortex-file-compressed: 479.69 MB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): 0.994x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-compact / ns (0.994x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 8401874 9007911 0.93
fineweb_q01/datafusion:vortex-compact 101255519 103192899 0.98
fineweb_q02/datafusion:vortex-compact 102101321 105232792 0.97
fineweb_q03/datafusion:vortex-compact 534979032 524754296 1.02
fineweb_q04/datafusion:vortex-compact 558350234 560255631 1.00
fineweb_q05/datafusion:vortex-compact 497260512 512590979 0.97
fineweb_q06/datafusion:vortex-compact 288593955 289150036 1.00
fineweb_q07/datafusion:vortex-compact 298162913 299424075 1.00
fineweb_q08/datafusion:vortex-compact 15439174 14192845 1.09
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 8598964 8833445 0.97
fineweb_q01/datafusion:parquet 194636030 197095030 0.99
fineweb_q02/datafusion:parquet 199327269 195168752 1.02
fineweb_q03/datafusion:parquet 190603622 192195481 0.99
fineweb_q04/datafusion:parquet 208511117 207334025 1.01
fineweb_q05/datafusion:parquet 204515803 204021292 1.00
fineweb_q06/datafusion:parquet 199730941 198024577 1.01
fineweb_q07/datafusion:parquet 195379376 191713668 1.02
fineweb_q08/datafusion:parquet 187869902 188533725 1.00
duckdb / vortex-compact / ns (0.993x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 5229554 5294676 0.99
fineweb_q01/duckdb:vortex-compact 109600694 110709264 0.99
fineweb_q02/duckdb:vortex-compact 115886620 117580253 0.99
fineweb_q03/duckdb:vortex-compact 345311802 353918462 0.98
fineweb_q04/duckdb:vortex-compact 398450079 388073213 1.03
fineweb_q05/duckdb:vortex-compact 353168013 353917023 1.00
fineweb_q06/duckdb:vortex-compact 229182143 235030992 0.98
fineweb_q07/duckdb:vortex-compact 234643311 236687037 0.99
fineweb_q08/duckdb:vortex-compact 29779727 29417964 1.01
duckdb / parquet / ns (1.006x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36770799 37437436 0.98
fineweb_q01/duckdb:parquet 78398393 76630109 1.02
fineweb_q02/duckdb:parquet 76939113 75410758 1.02
fineweb_q03/duckdb:parquet 206793302 206647027 1.00
fineweb_q04/duckdb:parquet 243139868 230884972 1.05
fineweb_q05/duckdb:parquet 201545323 201340775 1.00
fineweb_q06/duckdb:parquet 141537832 141606904 1.00
fineweb_q07/duckdb:parquet 144040568 143874816 1.00
fineweb_q08/duckdb:parquet 38224024 39039132 0.98
File Size Changes (2 files changed, -53.7% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-file-compressed 1.43 GB 0 B 1.43 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+0.7%, environment too noisy confidence) · DuckDB No clear signal (-1.8%, low confidence)
Vortex (geomean): 0.991x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-compact / ns (1.000x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 49296755 47777476 1.03
tpch_q02/datafusion:vortex-compact 26286377 26656650 0.99
tpch_q03/datafusion:vortex-compact 31884722 31729403 1.00
tpch_q04/datafusion:vortex-compact 18077502 17270204 1.05
tpch_q05/datafusion:vortex-compact 51816587 51226509 1.01
tpch_q06/datafusion:vortex-compact 9557742 9786504 0.98
tpch_q07/datafusion:vortex-compact 57907366 58528531 0.99
tpch_q08/datafusion:vortex-compact 47200796 47944990 0.98
tpch_q09/datafusion:vortex-compact 58676466 59563175 0.99
tpch_q10/datafusion:vortex-compact 34320394 34331023 1.00
tpch_q11/datafusion:vortex-compact 19837784 19752901 1.00
tpch_q12/datafusion:vortex-compact 31444706 31166062 1.01
tpch_q13/datafusion:vortex-compact 28427431 28766567 0.99
tpch_q14/datafusion:vortex-compact 18119454 17410251 1.04
tpch_q15/datafusion:vortex-compact 26094497 25603807 1.02
tpch_q16/datafusion:vortex-compact 28378206 28664435 0.99
tpch_q17/datafusion:vortex-compact 57344190 57726442 0.99
tpch_q18/datafusion:vortex-compact 67994700 70209776 0.97
tpch_q19/datafusion:vortex-compact 33008563 32864314 1.00
tpch_q20/datafusion:vortex-compact 34473467 34996910 0.99
tpch_q21/datafusion:vortex-compact 65781250 66373228 0.99
tpch_q22/datafusion:vortex-compact 13292375 13472122 0.99
datafusion / parquet / ns (0.992x ➖, 2↑ 2↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 109665144 127729161 0.86
tpch_q02/datafusion:parquet 69705676 71870663 0.97
tpch_q03/datafusion:parquet 🚨 104325203 94687538 1.10
tpch_q04/datafusion:parquet 50651093 49409631 1.03
tpch_q05/datafusion:parquet 123056674 128624959 0.96
tpch_q06/datafusion:parquet 🚨 48861429 42762459 1.14
tpch_q07/datafusion:parquet 129955042 134568041 0.97
tpch_q08/datafusion:parquet 122144580 119458081 1.02
tpch_q09/datafusion:parquet 157993612 160259327 0.99
tpch_q10/datafusion:parquet 120725847 122276551 0.99
tpch_q11/datafusion:parquet 50964231 51302789 0.99
tpch_q12/datafusion:parquet 93916176 101849787 0.92
tpch_q13/datafusion:parquet 227718062 220884390 1.03
tpch_q14/datafusion:parquet 50266439 50037596 1.00
tpch_q15/datafusion:parquet 71734710 70118920 1.02
tpch_q16/datafusion:parquet 51448391 50196809 1.02
tpch_q17/datafusion:parquet 157630054 150471778 1.05
tpch_q18/datafusion:parquet 183770844 181941476 1.01
tpch_q19/datafusion:parquet 🚀 72588566 87019952 0.83
tpch_q20/datafusion:parquet 95160841 94422855 1.01
tpch_q21/datafusion:parquet 166844276 169596113 0.98
tpch_q22/datafusion:parquet 55291341 56340454 0.98
duckdb / vortex-compact / ns (0.983x ➖, 1↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 33295943 31076432 1.07
tpch_q02/duckdb:vortex-compact 41898460 41879537 1.00
tpch_q03/duckdb:vortex-compact 42034716 41325853 1.02
tpch_q04/duckdb:vortex-compact 33900088 35388490 0.96
tpch_q05/duckdb:vortex-compact 45953212 46244347 0.99
tpch_q06/duckdb:vortex-compact 🚀 12519982 14966888 0.84
tpch_q07/duckdb:vortex-compact 46479805 46236214 1.01
tpch_q08/duckdb:vortex-compact 56570788 58015527 0.98
tpch_q09/duckdb:vortex-compact 66369527 68921930 0.96
tpch_q10/duckdb:vortex-compact 56444317 58192730 0.97
tpch_q11/duckdb:vortex-compact 21067792 20096483 1.05
tpch_q12/duckdb:vortex-compact 32781838 32947151 0.99
tpch_q13/duckdb:vortex-compact 45085759 46635893 0.97
tpch_q14/duckdb:vortex-compact 25845852 27508878 0.94
tpch_q15/duckdb:vortex-compact 21738061 22096519 0.98
tpch_q16/duckdb:vortex-compact 34609343 36127620 0.96
tpch_q17/duckdb:vortex-compact 38165653 38517380 0.99
tpch_q18/duckdb:vortex-compact 54765990 54465711 1.01
tpch_q19/duckdb:vortex-compact 39940024 40292830 0.99
tpch_q20/duckdb:vortex-compact 46357341 46838315 0.99
tpch_q21/duckdb:vortex-compact 126434850 126474375 1.00
tpch_q22/duckdb:vortex-compact 24721205 25086213 0.99
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 81595380 81703164 1.00
tpch_q02/duckdb:parquet 46183877 46303142 1.00
tpch_q03/duckdb:parquet 80982687 80774734 1.00
tpch_q04/duckdb:parquet 57742214 57814924 1.00
tpch_q05/duckdb:parquet 79635047 79109934 1.01
tpch_q06/duckdb:parquet 25375522 24893006 1.02
tpch_q07/duckdb:parquet 79940239 80002742 1.00
tpch_q08/duckdb:parquet 96894504 96851977 1.00
tpch_q09/duckdb:parquet 147998408 148641082 1.00
tpch_q10/duckdb:parquet 141834173 141971055 1.00
tpch_q11/duckdb:parquet 25263822 25580486 0.99
tpch_q12/duckdb:parquet 53521729 53129240 1.01
tpch_q13/duckdb:parquet 287906928 289047740 1.00
tpch_q14/duckdb:parquet 55965687 55991957 1.00
tpch_q15/duckdb:parquet 30720572 30770166 1.00
tpch_q16/duckdb:parquet 67021393 65809394 1.02
tpch_q17/duckdb:parquet 58224591 57679935 1.01
tpch_q18/duckdb:parquet 128398389 128016637 1.00
tpch_q19/duckdb:parquet 77873537 78245521 1.00
tpch_q20/duckdb:parquet 77503227 77807137 1.00
tpch_q21/duckdb:parquet 189242048 191615679 0.99
tpch_q22/duckdb:parquet 63942121 64362282 0.99
File Size Changes (9 files changed, -56.1% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-file-compressed 8.78 MB 0 B 8.78 MB -100.0%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 1.0 vortex-file-compressed 164.64 MB 0 B 164.64 MB -100.0%
nation.vortex 1.0 vortex-file-compressed 11.07 KB 0 B 11.07 KB -100.0%
orders.vortex 1.0 vortex-file-compressed 39.39 MB 0 B 39.39 MB -100.0%
part.vortex 1.0 vortex-file-compressed 5.33 MB 0 B 5.33 MB -100.0%
partsupp.vortex 1.0 vortex-file-compressed 23.83 MB 0 B 23.83 MB -100.0%
region.vortex 1.0 vortex-file-compressed 6.91 KB 0 B 6.91 KB -100.0%
supplier.vortex 1.0 vortex-file-compressed 611.36 KB 0 B 611.36 KB -100.0%

Totals:

  • vortex-compact: 189.73 MB → 189.73 MB (0.0%)
  • vortex-file-compressed: 242.85 MB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.9%, environment too noisy confidence)
Vortex (geomean): 1.009x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 2↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27054739 27695146 0.98
tpcds_q02/datafusion:vortex-file-compressed 51537439 52247797 0.99
tpcds_q03/datafusion:vortex-file-compressed 14041827 13850944 1.01
tpcds_q04/datafusion:vortex-file-compressed 220606811 220665499 1.00
tpcds_q05/datafusion:vortex-file-compressed 66394257 64477963 1.03
tpcds_q06/datafusion:vortex-file-compressed 26231500 26017558 1.01
tpcds_q07/datafusion:vortex-file-compressed 42269909 42839609 0.99
tpcds_q08/datafusion:vortex-file-compressed 33607584 33450358 1.00
tpcds_q09/datafusion:vortex-file-compressed 26488383 26388729 1.00
tpcds_q10/datafusion:vortex-file-compressed 36149360 36474222 0.99
tpcds_q11/datafusion:vortex-file-compressed 119763604 116261020 1.03
tpcds_q12/datafusion:vortex-file-compressed 20516447 20725547 0.99
tpcds_q13/datafusion:vortex-file-compressed 47210217 45884753 1.03
tpcds_q14/datafusion:vortex-file-compressed 209557571 204344454 1.03
tpcds_q15/datafusion:vortex-file-compressed 29286732 29512633 0.99
tpcds_q16/datafusion:vortex-file-compressed 24384892 24152175 1.01
tpcds_q17/datafusion:vortex-file-compressed 72256710 73006310 0.99
tpcds_q18/datafusion:vortex-file-compressed 89363836 88003071 1.02
tpcds_q19/datafusion:vortex-file-compressed 21283969 22279230 0.96
tpcds_q20/datafusion:vortex-file-compressed 22746263 23264128 0.98
tpcds_q21/datafusion:vortex-file-compressed 35037305 33909433 1.03
tpcds_q22/datafusion:vortex-file-compressed 🚨 129996020 112930381 1.15
tpcds_q23/datafusion:vortex-file-compressed 132911147 135629940 0.98
tpcds_q24/datafusion:vortex-file-compressed 98008703 96550580 1.02
tpcds_q25/datafusion:vortex-file-compressed 73279628 72368473 1.01
tpcds_q26/datafusion:vortex-file-compressed 37254319 36413587 1.02
tpcds_q27/datafusion:vortex-file-compressed 92284043 93206558 0.99
tpcds_q28/datafusion:vortex-file-compressed 29830588 28106344 1.06
tpcds_q29/datafusion:vortex-file-compressed 69522613 70833735 0.98
tpcds_q30/datafusion:vortex-file-compressed 30334877 28671084 1.06
tpcds_q31/datafusion:vortex-file-compressed 79121921 75199315 1.05
tpcds_q32/datafusion:vortex-file-compressed 18004575 18494378 0.97
tpcds_q33/datafusion:vortex-file-compressed 32652601 32308121 1.01
tpcds_q34/datafusion:vortex-file-compressed 26742473 26246029 1.02
tpcds_q35/datafusion:vortex-file-compressed 45970960 43901015 1.05
tpcds_q36/datafusion:vortex-file-compressed 64747468 64466250 1.00
tpcds_q37/datafusion:vortex-file-compressed 17780089 18447419 0.96
tpcds_q38/datafusion:vortex-file-compressed 42443773 39759167 1.07
tpcds_q39/datafusion:vortex-file-compressed 99442893 99982721 0.99
tpcds_q40/datafusion:vortex-file-compressed 33223327 32720540 1.02
tpcds_q41/datafusion:vortex-file-compressed 24502449 24377942 1.01
tpcds_q42/datafusion:vortex-file-compressed 13576873 13151504 1.03
tpcds_q43/datafusion:vortex-file-compressed 19483676 19485019 1.00
tpcds_q44/datafusion:vortex-file-compressed 33846593 34619463 0.98
tpcds_q45/datafusion:vortex-file-compressed 32543289 33049909 0.98
tpcds_q46/datafusion:vortex-file-compressed 35294647 34173512 1.03
tpcds_q47/datafusion:vortex-file-compressed 130267048 129408957 1.01
tpcds_q48/datafusion:vortex-file-compressed 39351118 38816054 1.01
tpcds_q49/datafusion:vortex-file-compressed 72443237 70821848 1.02
tpcds_q50/datafusion:vortex-file-compressed 47113901 49407073 0.95
tpcds_q51/datafusion:vortex-file-compressed 77242310 76334163 1.01
tpcds_q52/datafusion:vortex-file-compressed 14171336 14476664 0.98
tpcds_q53/datafusion:vortex-file-compressed 24231655 24223400 1.00
tpcds_q54/datafusion:vortex-file-compressed 38789109 37515845 1.03
tpcds_q55/datafusion:vortex-file-compressed 13871692 13764788 1.01
tpcds_q56/datafusion:vortex-file-compressed 33593770 33240253 1.01
tpcds_q57/datafusion:vortex-file-compressed 98259671 105627126 0.93
tpcds_q58/datafusion:vortex-file-compressed 60624588 61045934 0.99
tpcds_q59/datafusion:vortex-file-compressed 56549515 55072123 1.03
tpcds_q60/datafusion:vortex-file-compressed 32412895 33728473 0.96
tpcds_q61/datafusion:vortex-file-compressed 36915309 36234779 1.02
tpcds_q62/datafusion:vortex-file-compressed 24647047 23883984 1.03
tpcds_q63/datafusion:vortex-file-compressed 24473921 24011098 1.02
tpcds_q64/datafusion:vortex-file-compressed 477119441 473150340 1.01
tpcds_q65/datafusion:vortex-file-compressed 70801943 71855806 0.99
tpcds_q66/datafusion:vortex-file-compressed 77669621 79438414 0.98
tpcds_q67/datafusion:vortex-file-compressed 119787962 114441534 1.05
tpcds_q68/datafusion:vortex-file-compressed 32836606 32500808 1.01
tpcds_q69/datafusion:vortex-file-compressed 34214994 35286349 0.97
tpcds_q70/datafusion:vortex-file-compressed 115558883 108588559 1.06
tpcds_q71/datafusion:vortex-file-compressed 23280277 23347645 1.00
tpcds_q72/datafusion:vortex-file-compressed 1504718901 1475482485 1.02
tpcds_q73/datafusion:vortex-file-compressed 25695958 24266133 1.06
tpcds_q74/datafusion:vortex-file-compressed 77235169 75215726 1.03
tpcds_q75/datafusion:vortex-file-compressed 🚨 159442415 140261173 1.14
tpcds_q76/datafusion:vortex-file-compressed 41121238 43782766 0.94
tpcds_q77/datafusion:vortex-file-compressed 43904028 45293518 0.97
tpcds_q78/datafusion:vortex-file-compressed 111054174 118235071 0.94
tpcds_q79/datafusion:vortex-file-compressed 27938714 28409245 0.98
tpcds_q80/datafusion:vortex-file-compressed 101981525 102045463 1.00
tpcds_q81/datafusion:vortex-file-compressed 31123112 29038924 1.07
tpcds_q82/datafusion:vortex-file-compressed 20490567 19627996 1.04
tpcds_q83/datafusion:vortex-file-compressed 42063299 42867058 0.98
tpcds_q84/datafusion:vortex-file-compressed 13007643 13774158 0.94
tpcds_q85/datafusion:vortex-file-compressed 115953325 113527573 1.02
tpcds_q86/datafusion:vortex-file-compressed 18944213 19488498 0.97
tpcds_q87/datafusion:vortex-file-compressed 42166310 42037854 1.00
tpcds_q88/datafusion:vortex-file-compressed 53437489 53210016 1.00
tpcds_q89/datafusion:vortex-file-compressed 29314603 31131459 0.94
tpcds_q90/datafusion:vortex-file-compressed 14493649 14902853 0.97
tpcds_q91/datafusion:vortex-file-compressed 20264402 20222827 1.00
tpcds_q92/datafusion:vortex-file-compressed 16883627 18175612 0.93
tpcds_q93/datafusion:vortex-file-compressed 31340432 31596045 0.99
tpcds_q94/datafusion:vortex-file-compressed 23175899 23740154 0.98
tpcds_q95/datafusion:vortex-file-compressed 63695174 63092999 1.01
tpcds_q96/datafusion:vortex-file-compressed 11263496 11714789 0.96
tpcds_q97/datafusion:vortex-file-compressed 29159848 28040028 1.04
tpcds_q98/datafusion:vortex-file-compressed 24518671 25371755 0.97
tpcds_q99/datafusion:vortex-file-compressed 27934140 29588273 0.94
datafusion / parquet / ns (1.002x ➖, 1↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30351702 31626734 0.96
tpcds_q02/datafusion:parquet 53606276 52225436 1.03
tpcds_q03/datafusion:parquet 16957970 16893229 1.00
tpcds_q04/datafusion:parquet 340502776 333567003 1.02
tpcds_q05/datafusion:parquet 80248193 79777991 1.01
tpcds_q06/datafusion:parquet 31431248 31016263 1.01
tpcds_q07/datafusion:parquet 97537111 96672385 1.01
tpcds_q08/datafusion:parquet 38274081 38300405 1.00
tpcds_q09/datafusion:parquet 37609503 37900365 0.99
tpcds_q10/datafusion:parquet 87580270 91100890 0.96
tpcds_q11/datafusion:parquet 163649040 167097407 0.98
tpcds_q12/datafusion:parquet 22071463 22190416 0.99
tpcds_q13/datafusion:parquet 98577650 99021052 1.00
tpcds_q14/datafusion:parquet 279914631 281303166 1.00
tpcds_q15/datafusion:parquet 38342701 37593884 1.02
tpcds_q16/datafusion:parquet 47757245 49468363 0.97
tpcds_q17/datafusion:parquet 104605850 108068196 0.97
tpcds_q18/datafusion:parquet 139758597 131977227 1.06
tpcds_q19/datafusion:parquet 28890319 28720408 1.01
tpcds_q20/datafusion:parquet 23327208 23204000 1.01
tpcds_q21/datafusion:parquet 22328436 23306099 0.96
tpcds_q22/datafusion:parquet 🚨 125336508 110095641 1.14
tpcds_q23/datafusion:parquet 171136179 174050496 0.98
tpcds_q24/datafusion:parquet 138421713 137068755 1.01
tpcds_q25/datafusion:parquet 107331744 106305515 1.01
tpcds_q26/datafusion:parquet 84280225 85394710 0.99
tpcds_q27/datafusion:parquet 159596469 160545846 0.99
tpcds_q28/datafusion:parquet 41136772 41910761 0.98
tpcds_q29/datafusion:parquet 108018267 105202121 1.03
tpcds_q30/datafusion:parquet 43561059 45205253 0.96
tpcds_q31/datafusion:parquet 94628064 93177737 1.02
tpcds_q32/datafusion:parquet 25057000 24328489 1.03
tpcds_q33/datafusion:parquet 38642564 38687098 1.00
tpcds_q34/datafusion:parquet 29813705 30516198 0.98
tpcds_q35/datafusion:parquet 92536588 89251521 1.04
tpcds_q36/datafusion:parquet 69407568 69694789 1.00
tpcds_q37/datafusion:parquet 24211510 23728854 1.02
tpcds_q38/datafusion:parquet 62120633 57431403 1.08
tpcds_q39/datafusion:parquet 83923575 81851867 1.03
tpcds_q40/datafusion:parquet 32766855 34235753 0.96
tpcds_q41/datafusion:parquet 19000770 19725006 0.96
tpcds_q42/datafusion:parquet 16701064 16059244 1.04
tpcds_q43/datafusion:parquet 23591683 22914197 1.03
tpcds_q44/datafusion:parquet 40200961 41173047 0.98
tpcds_q45/datafusion:parquet 46562122 44942681 1.04
tpcds_q46/datafusion:parquet 40875043 41625034 0.98
tpcds_q47/datafusion:parquet 150804376 150681157 1.00
tpcds_q48/datafusion:parquet 87390807 88993882 0.98
tpcds_q49/datafusion:parquet 79202165 78548153 1.01
tpcds_q50/datafusion:parquet 67599929 72452472 0.93
tpcds_q51/datafusion:parquet 82695919 82545524 1.00
tpcds_q52/datafusion:parquet 17178151 16544541 1.04
tpcds_q53/datafusion:parquet 24771255 25066360 0.99
tpcds_q54/datafusion:parquet 45719192 47596292 0.96
tpcds_q55/datafusion:parquet 16645677 16824382 0.99
tpcds_q56/datafusion:parquet 36951215 36188293 1.02
tpcds_q57/datafusion:parquet 122765143 123080404 1.00
tpcds_q58/datafusion:parquet 80809666 80615470 1.00
tpcds_q59/datafusion:parquet 74887342 76025026 0.99
tpcds_q60/datafusion:parquet 38820431 36588872 1.06
tpcds_q61/datafusion:parquet 47212956 44963092 1.05
tpcds_q62/datafusion:parquet 33527158 32955549 1.02
tpcds_q63/datafusion:parquet 25202381 24912189 1.01
tpcds_q64/datafusion:parquet 367304760 358256681 1.03
tpcds_q65/datafusion:parquet 49002203 53371189 0.92
tpcds_q66/datafusion:parquet 88347384 86455581 1.02
tpcds_q67/datafusion:parquet 142354791 147397637 0.97
tpcds_q68/datafusion:parquet 41590755 39987588 1.04
tpcds_q69/datafusion:parquet 83797212 82119973 1.02
tpcds_q70/datafusion:parquet 45086700 44620081 1.01
tpcds_q71/datafusion:parquet 27410206 25798033 1.06
tpcds_q72/datafusion:parquet 464278444 453837572 1.02
tpcds_q73/datafusion:parquet 28521589 27328360 1.04
tpcds_q74/datafusion:parquet 106402385 101322736 1.05
tpcds_q75/datafusion:parquet 174991161 183531290 0.95
tpcds_q76/datafusion:parquet 60020148 62838206 0.96
tpcds_q77/datafusion:parquet 55481721 57470169 0.97
tpcds_q78/datafusion:parquet 124450083 121575988 1.02
tpcds_q79/datafusion:parquet 35128442 34769201 1.01
tpcds_q80/datafusion:parquet 98163355 98549689 1.00
tpcds_q81/datafusion:parquet 40949371 39733412 1.03
tpcds_q82/datafusion:parquet 23091867 23999989 0.96
tpcds_q83/datafusion:parquet 57956059 57580955 1.01
tpcds_q84/datafusion:parquet 49399991 48325784 1.02
tpcds_q85/datafusion:parquet 200296229 195894154 1.02
tpcds_q86/datafusion:parquet 🚀 21217302 23826092 0.89
tpcds_q87/datafusion:parquet 61268776 63085443 0.97
tpcds_q88/datafusion:parquet 59429970 59580270 1.00
tpcds_q89/datafusion:parquet 30228738 30223149 1.00
tpcds_q90/datafusion:parquet 18964802 18652247 1.02
tpcds_q91/datafusion:parquet 67487554 68145598 0.99
tpcds_q92/datafusion:parquet 24870201 24782987 1.00
tpcds_q93/datafusion:parquet 37589566 36817830 1.02
tpcds_q94/datafusion:parquet 30013627 30810944 0.97
tpcds_q95/datafusion:parquet 91686003 89083821 1.03
tpcds_q96/datafusion:parquet 16999488 16477220 1.03
tpcds_q97/datafusion:parquet 39285333 39807281 0.99
tpcds_q98/datafusion:parquet 27240527 27327871 1.00
tpcds_q99/datafusion:parquet 33994892 34875740 0.97
duckdb / vortex-file-compressed / ns (1.014x ➖, 6↑ 10↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 30124771 28182421 1.07
tpcds_q02/duckdb:vortex-file-compressed 29364162 28843630 1.02
tpcds_q03/duckdb:vortex-file-compressed 22310476 22802950 0.98
tpcds_q04/duckdb:vortex-file-compressed 99035439 96148630 1.03
tpcds_q05/duckdb:vortex-file-compressed 40960485 42249929 0.97
tpcds_q06/duckdb:vortex-file-compressed 51423448 52785640 0.97
tpcds_q07/duckdb:vortex-file-compressed 32939619 32334594 1.02
tpcds_q08/duckdb:vortex-file-compressed 35120433 34738282 1.01
tpcds_q09/duckdb:vortex-file-compressed 🚀 17737275 21334069 0.83
tpcds_q10/duckdb:vortex-file-compressed 54847328 56338270 0.97
tpcds_q11/duckdb:vortex-file-compressed 75654327 74453651 1.02
tpcds_q12/duckdb:vortex-file-compressed 🚨 20314598 18247745 1.11
tpcds_q13/duckdb:vortex-file-compressed 43071287 42180724 1.02
tpcds_q14/duckdb:vortex-file-compressed 117876204 113516726 1.04
tpcds_q15/duckdb:vortex-file-compressed 35818020 33906448 1.06
tpcds_q16/duckdb:vortex-file-compressed 🚨 36739331 33178188 1.11
tpcds_q17/duckdb:vortex-file-compressed 58781432 58037177 1.01
tpcds_q18/duckdb:vortex-file-compressed 49667739 49642629 1.00
tpcds_q19/duckdb:vortex-file-compressed 41791963 38885652 1.07
tpcds_q20/duckdb:vortex-file-compressed 19846968 18351725 1.08
tpcds_q21/duckdb:vortex-file-compressed 21264165 21332844 1.00
tpcds_q22/duckdb:vortex-file-compressed 69343605 67011667 1.03
tpcds_q23/duckdb:vortex-file-compressed 79666235 76025498 1.05
tpcds_q24/duckdb:vortex-file-compressed 51232248 50672480 1.01
tpcds_q25/duckdb:vortex-file-compressed 50699653 49785964 1.02
tpcds_q26/duckdb:vortex-file-compressed 22764230 24595566 0.93
tpcds_q27/duckdb:vortex-file-compressed 35939615 35695000 1.01
tpcds_q28/duckdb:vortex-file-compressed 17236191 16906677 1.02
tpcds_q29/duckdb:vortex-file-compressed 57211545 58379494 0.98
tpcds_q30/duckdb:vortex-file-compressed 37811857 36659824 1.03
tpcds_q31/duckdb:vortex-file-compressed 36927958 35580841 1.04
tpcds_q32/duckdb:vortex-file-compressed 21456627 21003919 1.02
tpcds_q33/duckdb:vortex-file-compressed 33884128 32994503 1.03
tpcds_q34/duckdb:vortex-file-compressed 32835935 31276772 1.05
tpcds_q35/duckdb:vortex-file-compressed 87349905 87089340 1.00
tpcds_q36/duckdb:vortex-file-compressed 34067117 32513979 1.05
tpcds_q37/duckdb:vortex-file-compressed 28373366 27673691 1.03
tpcds_q38/duckdb:vortex-file-compressed 43078456 41551154 1.04
tpcds_q39/duckdb:vortex-file-compressed 38238474 39137225 0.98
tpcds_q40/duckdb:vortex-file-compressed 24622376 25217802 0.98
tpcds_q41/duckdb:vortex-file-compressed 20537696 19612597 1.05
tpcds_q42/duckdb:vortex-file-compressed 21377908 20383212 1.05
tpcds_q43/duckdb:vortex-file-compressed 🚨 22660966 20556982 1.10
tpcds_q44/duckdb:vortex-file-compressed 27013624 27563577 0.98
tpcds_q45/duckdb:vortex-file-compressed 40731289 38172271 1.07
tpcds_q46/duckdb:vortex-file-compressed 40262363 38885464 1.04
tpcds_q47/duckdb:vortex-file-compressed 58817727 58158450 1.01
tpcds_q48/duckdb:vortex-file-compressed 40541938 37723863 1.07
tpcds_q49/duckdb:vortex-file-compressed 43542985 43254396 1.01
tpcds_q50/duckdb:vortex-file-compressed 34668846 33643897 1.03
tpcds_q51/duckdb:vortex-file-compressed 🚀 108400231 137367573 0.79
tpcds_q52/duckdb:vortex-file-compressed 🚨 20886946 17137649 1.22
tpcds_q53/duckdb:vortex-file-compressed 30241140 31239853 0.97
tpcds_q54/duckdb:vortex-file-compressed 44894904 48214774 0.93
tpcds_q55/duckdb:vortex-file-compressed 17367927 18415567 0.94
tpcds_q56/duckdb:vortex-file-compressed 🚨 37078379 33625021 1.10
tpcds_q57/duckdb:vortex-file-compressed 45887253 47939600 0.96
tpcds_q58/duckdb:vortex-file-compressed 40170699 43993258 0.91
tpcds_q59/duckdb:vortex-file-compressed 43623854 41731698 1.05
tpcds_q60/duckdb:vortex-file-compressed 37130677 36993801 1.00
tpcds_q61/duckdb:vortex-file-compressed 40154991 40012864 1.00
tpcds_q62/duckdb:vortex-file-compressed 21967023 23163338 0.95
tpcds_q63/duckdb:vortex-file-compressed 28994408 29837029 0.97
tpcds_q64/duckdb:vortex-file-compressed 121667297 113999809 1.07
tpcds_q65/duckdb:vortex-file-compressed 29391523 29251338 1.00
tpcds_q66/duckdb:vortex-file-compressed 37538176 38362254 0.98
tpcds_q67/duckdb:vortex-file-compressed 134885277 129478318 1.04
tpcds_q68/duckdb:vortex-file-compressed 🚨 42984390 35787493 1.20
tpcds_q69/duckdb:vortex-file-compressed 64336886 61682195 1.04
tpcds_q70/duckdb:vortex-file-compressed 42686108 42652838 1.00
tpcds_q71/duckdb:vortex-file-compressed 🚨 29029884 26128336 1.11
tpcds_q72/duckdb:vortex-file-compressed 151149257 153088687 0.99
tpcds_q73/duckdb:vortex-file-compressed 33604476 30683467 1.10
tpcds_q74/duckdb:vortex-file-compressed 51739451 51964328 1.00
tpcds_q75/duckdb:vortex-file-compressed 62093477 59903019 1.04
tpcds_q76/duckdb:vortex-file-compressed 26129027 25206687 1.04
tpcds_q77/duckdb:vortex-file-compressed 🚀 31225211 34856418 0.90
tpcds_q78/duckdb:vortex-file-compressed 81225913 77044012 1.05
tpcds_q79/duckdb:vortex-file-compressed 34267380 32297469 1.06
tpcds_q80/duckdb:vortex-file-compressed 61351122 58272198 1.05
tpcds_q81/duckdb:vortex-file-compressed 🚀 40373292 45146350 0.89
tpcds_q82/duckdb:vortex-file-compressed 54863074 56909247 0.96
tpcds_q83/duckdb:vortex-file-compressed 46020914 43320827 1.06
tpcds_q84/duckdb:vortex-file-compressed 30018691 29813122 1.01
tpcds_q85/duckdb:vortex-file-compressed 56920119 56565581 1.01
tpcds_q86/duckdb:vortex-file-compressed 19917646 19064575 1.04
tpcds_q87/duckdb:vortex-file-compressed 48066721 48572025 0.99
tpcds_q88/duckdb:vortex-file-compressed 62037934 62498524 0.99
tpcds_q89/duckdb:vortex-file-compressed 🚨 32844921 28692690 1.14
tpcds_q90/duckdb:vortex-file-compressed 16211333 17835233 0.91
tpcds_q91/duckdb:vortex-file-compressed 🚀 32140163 37468351 0.86
tpcds_q92/duckdb:vortex-file-compressed 24250836 25144777 0.96
tpcds_q93/duckdb:vortex-file-compressed 🚨 33169882 30101948 1.10
tpcds_q94/duckdb:vortex-file-compressed 🚀 32098567 36728289 0.87
tpcds_q95/duckdb:vortex-file-compressed 151137504 152228827 0.99
tpcds_q96/duckdb:vortex-file-compressed 19078750 18130475 1.05
tpcds_q97/duckdb:vortex-file-compressed 46107101 45457465 1.01
tpcds_q98/duckdb:vortex-file-compressed 🚨 27004246 22765253 1.19
tpcds_q99/duckdb:vortex-file-compressed 26065160 25313737 1.03
duckdb / parquet / ns (1.005x ➖, 2↑ 8↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 31728362 32838144 0.97
tpcds_q02/duckdb:parquet 🚨 25765934 22557397 1.14
tpcds_q03/duckdb:parquet 🚨 14177341 12176712 1.16
tpcds_q04/duckdb:parquet 194660783 196741576 0.99
tpcds_q05/duckdb:parquet 33029922 33334205 0.99
tpcds_q06/duckdb:parquet 35360541 36238593 0.98
tpcds_q07/duckdb:parquet 22098176 22044429 1.00
tpcds_q08/duckdb:parquet 33530625 33159581 1.01
tpcds_q09/duckdb:parquet 29944709 30237281 0.99
tpcds_q10/duckdb:parquet 43703472 40723073 1.07
tpcds_q11/duckdb:parquet 109949007 102177647 1.08
tpcds_q12/duckdb:parquet 17828394 18112092 0.98
tpcds_q13/duckdb:parquet 🚨 39956029 34392943 1.16
tpcds_q14/duckdb:parquet 104520797 104506769 1.00
tpcds_q15/duckdb:parquet 34703994 35802612 0.97
tpcds_q16/duckdb:parquet 27627726 27486797 1.01
tpcds_q17/duckdb:parquet 45529111 45471708 1.00
tpcds_q18/duckdb:parquet 56135339 57339683 0.98
tpcds_q19/duckdb:parquet 33622776 33677202 1.00
tpcds_q20/duckdb:parquet 19573674 19352542 1.01
tpcds_q21/duckdb:parquet 14286238 13750851 1.04
tpcds_q22/duckdb:parquet 67531621 64186012 1.05
tpcds_q23/duckdb:parquet 67294625 67523993 1.00
tpcds_q24/duckdb:parquet 48989082 48769571 1.00
tpcds_q25/duckdb:parquet 42685197 42355904 1.01
tpcds_q26/duckdb:parquet 43443849 45959490 0.95
tpcds_q27/duckdb:parquet 55060882 57809439 0.95
tpcds_q28/duckdb:parquet 29840958 28844719 1.03
tpcds_q29/duckdb:parquet 42701616 42731772 1.00
tpcds_q30/duckdb:parquet 43633970 44069597 0.99
tpcds_q31/duckdb:parquet 29455443 28876524 1.02
tpcds_q32/duckdb:parquet 14931545 15259595 0.98
tpcds_q33/duckdb:parquet 23394242 24109326 0.97
tpcds_q34/duckdb:parquet 22070231 21558686 1.02
tpcds_q35/duckdb:parquet 68393805 67836889 1.01
tpcds_q36/duckdb:parquet 🚨 24830021 22099616 1.12
tpcds_q37/duckdb:parquet 18946305 17934511 1.06
tpcds_q38/duckdb:parquet 40386335 40551300 1.00
tpcds_q39/duckdb:parquet 37861238 37440414 1.01
tpcds_q40/duckdb:parquet 22602318 22918748 0.99
tpcds_q41/duckdb:parquet 10303008 10525274 0.98
tpcds_q42/duckdb:parquet 🚨 13314921 11772040 1.13
tpcds_q43/duckdb:parquet 14608128 14588447 1.00
tpcds_q44/duckdb:parquet 25183845 24700431 1.02
tpcds_q45/duckdb:parquet 32489599 32623118 1.00
tpcds_q46/duckdb:parquet 50664614 49763418 1.02
tpcds_q47/duckdb:parquet 47952017 48847535 0.98
tpcds_q48/duckdb:parquet 30194851 30632123 0.99
tpcds_q49/duckdb:parquet 28080630 27974724 1.00
tpcds_q50/duckdb:parquet 25181420 26023473 0.97
tpcds_q51/duckdb:parquet 96020423 97835852 0.98
tpcds_q52/duckdb:parquet 11769690 12271663 0.96
tpcds_q53/duckdb:parquet 🚀 15887061 18035194 0.88
tpcds_q54/duckdb:parquet 30873748 30660340 1.01
tpcds_q55/duckdb:parquet 11939383 11675220 1.02
tpcds_q56/duckdb:parquet 24918579 23947627 1.04
tpcds_q57/duckdb:parquet 42678038 45656815 0.93
tpcds_q58/duckdb:parquet 26598200 27030736 0.98
tpcds_q59/duckdb:parquet 29554484 30579293 0.97
tpcds_q60/duckdb:parquet 26051995 25108494 1.04
tpcds_q61/duckdb:parquet 31807725 31439454 1.01
tpcds_q62/duckdb:parquet 14888371 14769558 1.01
tpcds_q63/duckdb:parquet 🚨 17492615 15246747 1.15
tpcds_q64/duckdb:parquet 80557028 79347859 1.02
tpcds_q65/duckdb:parquet 21695941 21658301 1.00
tpcds_q66/duckdb:parquet 34825746 34613923 1.01
tpcds_q67/duckdb:parquet 120514777 126099534 0.96
tpcds_q68/duckdb:parquet 38682940 39436216 0.98
tpcds_q69/duckdb:parquet 🚨 46303245 41536299 1.11
tpcds_q70/duckdb:parquet 26946998 26249105 1.03
tpcds_q71/duckdb:parquet 20840960 21417506 0.97
tpcds_q72/duckdb:parquet 121088431 126109095 0.96
tpcds_q73/duckdb:parquet 🚀 18499928 21577041 0.86
tpcds_q74/duckdb:parquet 147775243 147898692 1.00
tpcds_q75/duckdb:parquet 62437623 60132198 1.04
tpcds_q76/duckdb:parquet 19971338 19816894 1.01
tpcds_q77/duckdb:parquet 24512860 24855899 0.99
tpcds_q78/duckdb:parquet 77241547 77087212 1.00
tpcds_q79/duckdb:parquet 27677835 27861237 0.99
tpcds_q80/duckdb:parquet 47161015 49243376 0.96
tpcds_q81/duckdb:parquet 40690933 41075545 0.99
tpcds_q82/duckdb:parquet 19307842 19624100 0.98
tpcds_q83/duckdb:parquet 22192393 22134525 1.00
tpcds_q84/duckdb:parquet 24278185 23767573 1.02
tpcds_q85/duckdb:parquet 48135571 47890115 1.01
tpcds_q86/duckdb:parquet 14829103 15279341 0.97
tpcds_q87/duckdb:parquet 44008683 43716017 1.01
tpcds_q88/duckdb:parquet 42826643 42781679 1.00
tpcds_q89/duckdb:parquet 🚨 20442720 18037226 1.13
tpcds_q90/duckdb:parquet 9707758 10227310 0.95
tpcds_q91/duckdb:parquet 27140213 27570609 0.98
tpcds_q92/duckdb:parquet 15530998 15192260 1.02
tpcds_q93/duckdb:parquet 31409558 34522310 0.91
tpcds_q94/duckdb:parquet 21614254 21598989 1.00
tpcds_q95/duckdb:parquet 137610561 138991868 0.99
tpcds_q96/duckdb:parquet 10058791 9848430 1.02
tpcds_q97/duckdb:parquet 38851840 38866485 1.00
tpcds_q98/duckdb:parquet 21642182 21389925 1.01
tpcds_q99/duckdb:parquet 23561388 23422841 1.01
File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-compact 47.68 KB 0 B 47.68 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 362.70 KB 0 B 362.70 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.04 MB 0 B 6.04 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.49 MB 0 B 59.49 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 639.07 KB 0 B 639.07 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 424.41 KB 0 B 424.41 KB -100.0%
date_dim.vortex 1.0 vortex-compact 140.51 KB 0 B 140.51 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 10.52 KB 0 B 10.52 KB -100.0%
income_band.vortex 1.0 vortex-compact 5.80 KB 0 B 5.80 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 0 B 16.07 MB -100.0%
item.vortex 1.0 vortex-compact 1000.57 KB 0 B 1000.57 KB -100.0%
promotion.vortex 1.0 vortex-compact 50.55 KB 0 B 50.55 KB -100.0%
reason.vortex 1.0 vortex-compact 6.20 KB 0 B 6.20 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 10.96 KB 0 B 10.96 KB -100.0%
store.vortex 1.0 vortex-compact 43.47 KB 0 B 43.47 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.36 MB 0 B 9.36 MB -100.0%
store_sales.vortex 1.0 vortex-compact 78.12 MB 0 B 78.12 MB -100.0%
time_dim.vortex 1.0 vortex-compact 96.83 KB 0 B 96.83 KB -100.0%
warehouse.vortex 1.0 vortex-compact 22.38 KB 0 B 22.38 KB -100.0%
web_page.vortex 1.0 vortex-compact 25.24 KB 0 B 25.24 KB -100.0%
web_returns.vortex 1.0 vortex-compact 3.00 MB 0 B 3.00 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.45 MB 0 B 29.45 MB -100.0%
web_site.vortex 1.0 vortex-compact 42.43 KB 0 B 42.43 KB -100.0%

Totals:

  • vortex-compact: 207.95 MB → 0 B (-100.0%)
  • vortex-file-compressed: 269.98 MB → 269.98 MB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.6%, low confidence) · DuckDB No clear signal (-0.3%, environment too noisy confidence)
Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-compact / ns (1.006x ➖, 1↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 30813423 30178251 1.02
tpcds_q02/datafusion:vortex-compact 58082967 59351526 0.98
tpcds_q03/datafusion:vortex-compact 17019237 17303386 0.98
tpcds_q04/datafusion:vortex-compact 246264204 250822270 0.98
tpcds_q05/datafusion:vortex-compact 63966794 67061917 0.95
tpcds_q06/datafusion:vortex-compact 29236037 29345568 1.00
tpcds_q07/datafusion:vortex-compact 55112118 54947553 1.00
tpcds_q08/datafusion:vortex-compact 43195692 43207490 1.00
tpcds_q09/datafusion:vortex-compact 42981639 42912157 1.00
tpcds_q10/datafusion:vortex-compact 54323141 53716819 1.01
tpcds_q11/datafusion:vortex-compact 132132851 133505485 0.99
tpcds_q12/datafusion:vortex-compact 26652306 25097827 1.06
tpcds_q13/datafusion:vortex-compact 🚀 118682915 140920061 0.84
tpcds_q14/datafusion:vortex-compact 223735765 217220405 1.03
tpcds_q15/datafusion:vortex-compact 34788672 33627941 1.03
tpcds_q16/datafusion:vortex-compact 32054827 31233776 1.03
tpcds_q17/datafusion:vortex-compact 108883811 111995459 0.97
tpcds_q18/datafusion:vortex-compact 102773327 101362445 1.01
tpcds_q19/datafusion:vortex-compact 30238183 30494132 0.99
tpcds_q20/datafusion:vortex-compact 27411888 26740065 1.03
tpcds_q21/datafusion:vortex-compact 35175133 37265338 0.94
tpcds_q22/datafusion:vortex-compact 🚨 119823405 92696892 1.29
tpcds_q23/datafusion:vortex-compact 141099430 144628010 0.98
tpcds_q24/datafusion:vortex-compact 115650941 115375773 1.00
tpcds_q25/datafusion:vortex-compact 84401432 87061872 0.97
tpcds_q26/datafusion:vortex-compact 50688008 51348048 0.99
tpcds_q27/datafusion:vortex-compact 121509344 116627024 1.04
tpcds_q28/datafusion:vortex-compact 65901822 62587479 1.05
tpcds_q29/datafusion:vortex-compact 83457554 83818018 1.00
tpcds_q30/datafusion:vortex-compact 33289485 33219852 1.00
tpcds_q31/datafusion:vortex-compact 100268614 100308558 1.00
tpcds_q32/datafusion:vortex-compact 22477821 23610023 0.95
tpcds_q33/datafusion:vortex-compact 38878767 38902326 1.00
tpcds_q34/datafusion:vortex-compact 37652470 37424346 1.01
tpcds_q35/datafusion:vortex-compact 58826821 57947235 1.02
tpcds_q36/datafusion:vortex-compact 74264436 74255342 1.00
tpcds_q37/datafusion:vortex-compact 24514986 24570447 1.00
tpcds_q38/datafusion:vortex-compact 50787884 51098673 0.99
tpcds_q39/datafusion:vortex-compact 107668421 107558748 1.00
tpcds_q40/datafusion:vortex-compact 36680155 36224997 1.01
tpcds_q41/datafusion:vortex-compact 26594066 26852238 0.99
tpcds_q42/datafusion:vortex-compact 16340835 16748861 0.98
tpcds_q43/datafusion:vortex-compact 24947703 22981630 1.09
tpcds_q44/datafusion:vortex-compact 47318344 49614635 0.95
tpcds_q45/datafusion:vortex-compact 38905772 38931122 1.00
tpcds_q46/datafusion:vortex-compact 46534758 45443533 1.02
tpcds_q47/datafusion:vortex-compact 148290630 141638336 1.05
tpcds_q48/datafusion:vortex-compact 90638442 92075999 0.98
tpcds_q49/datafusion:vortex-compact 87089832 86096808 1.01
tpcds_q50/datafusion:vortex-compact 56975644 56236516 1.01
tpcds_q51/datafusion:vortex-compact 81271163 81587390 1.00
tpcds_q52/datafusion:vortex-compact 17669630 17528019 1.01
tpcds_q53/datafusion:vortex-compact 28891606 28782145 1.00
tpcds_q54/datafusion:vortex-compact 45496592 45993785 0.99
tpcds_q55/datafusion:vortex-compact 16625396 16711867 0.99
tpcds_q56/datafusion:vortex-compact 39491117 39115834 1.01
tpcds_q57/datafusion:vortex-compact 111299248 110086019 1.01
tpcds_q58/datafusion:vortex-compact 66069893 65619863 1.01
tpcds_q59/datafusion:vortex-compact 63291695 64968089 0.97
tpcds_q60/datafusion:vortex-compact 38584896 39951937 0.97
tpcds_q61/datafusion:vortex-compact 47405571 47064868 1.01
tpcds_q62/datafusion:vortex-compact 28212328 27024634 1.04
tpcds_q63/datafusion:vortex-compact 30425983 29901179 1.02
tpcds_q64/datafusion:vortex-compact 541261410 547098212 0.99
tpcds_q65/datafusion:vortex-compact 86431569 83283162 1.04
tpcds_q66/datafusion:vortex-compact 83158730 82812081 1.00
tpcds_q67/datafusion:vortex-compact 132002777 123395958 1.07
tpcds_q68/datafusion:vortex-compact 47947815 46936873 1.02
tpcds_q69/datafusion:vortex-compact 51979230 51660732 1.01
tpcds_q70/datafusion:vortex-compact 124025401 119502585 1.04
tpcds_q71/datafusion:vortex-compact 30271865 30115881 1.01
tpcds_q72/datafusion:vortex-compact 1498189928 1474243358 1.02
tpcds_q73/datafusion:vortex-compact 34764516 34958179 0.99
tpcds_q74/datafusion:vortex-compact 92981372 89241984 1.04
tpcds_q75/datafusion:vortex-compact 160168739 166201814 0.96
tpcds_q76/datafusion:vortex-compact 47822169 48988236 0.98
tpcds_q77/datafusion:vortex-compact 51492952 50417858 1.02
tpcds_q78/datafusion:vortex-compact 134967987 129750924 1.04
tpcds_q79/datafusion:vortex-compact 39057568 39949794 0.98
tpcds_q80/datafusion:vortex-compact 117646909 110420178 1.07
tpcds_q81/datafusion:vortex-compact 32956915 34675278 0.95
tpcds_q82/datafusion:vortex-compact 27095694 25492027 1.06
tpcds_q83/datafusion:vortex-compact 43149824 43307371 1.00
tpcds_q84/datafusion:vortex-compact 14518062 14837897 0.98
tpcds_q85/datafusion:vortex-compact 168703772 165390981 1.02
tpcds_q86/datafusion:vortex-compact 21016231 20536004 1.02
tpcds_q87/datafusion:vortex-compact 55454764 52344032 1.06
tpcds_q88/datafusion:vortex-compact 82112117 82194558 1.00
tpcds_q89/datafusion:vortex-compact 32798722 32798824 1.00
tpcds_q90/datafusion:vortex-compact 16449994 17244104 0.95
tpcds_q91/datafusion:vortex-compact 43188845 41761290 1.03
tpcds_q92/datafusion:vortex-compact 22287564 20768152 1.07
tpcds_q93/datafusion:vortex-compact 38838691 38144246 1.02
tpcds_q94/datafusion:vortex-compact 28469080 29532313 0.96
tpcds_q95/datafusion:vortex-compact 69442813 69928474 0.99
tpcds_q96/datafusion:vortex-compact 17705569 16942741 1.05
tpcds_q97/datafusion:vortex-compact 34409152 34180593 1.01
tpcds_q98/datafusion:vortex-compact 30410044 30026250 1.01
tpcds_q99/datafusion:vortex-compact 31372859 32201714 0.97
datafusion / parquet / ns (1.000x ➖, 1↑ 2↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30257381 31626734 0.96
tpcds_q02/datafusion:parquet 51947105 52225436 0.99
tpcds_q03/datafusion:parquet 17405057 16893229 1.03
tpcds_q04/datafusion:parquet 330433721 333567003 0.99
tpcds_q05/datafusion:parquet 79788352 79777991 1.00
tpcds_q06/datafusion:parquet 29995293 31016263 0.97
tpcds_q07/datafusion:parquet 97399269 96672385 1.01
tpcds_q08/datafusion:parquet 39167569 38300405 1.02
tpcds_q09/datafusion:parquet 35641017 37900365 0.94
tpcds_q10/datafusion:parquet 88545690 91100890 0.97
tpcds_q11/datafusion:parquet 168987491 167097407 1.01
tpcds_q12/datafusion:parquet 22226525 22190416 1.00
tpcds_q13/datafusion:parquet 97909352 99021052 0.99
tpcds_q14/datafusion:parquet 282232866 281303166 1.00
tpcds_q15/datafusion:parquet 39115486 37593884 1.04
tpcds_q16/datafusion:parquet 48903786 49468363 0.99
tpcds_q17/datafusion:parquet 107223572 108068196 0.99
tpcds_q18/datafusion:parquet 129949668 131977227 0.98
tpcds_q19/datafusion:parquet 28638849 28720408 1.00
tpcds_q20/datafusion:parquet 23606579 23204000 1.02
tpcds_q21/datafusion:parquet 23442913 23306099 1.01
tpcds_q22/datafusion:parquet 🚨 129994251 110095641 1.18
tpcds_q23/datafusion:parquet 170704068 174050496 0.98
tpcds_q24/datafusion:parquet 134297772 137068755 0.98
tpcds_q25/datafusion:parquet 105493743 106305515 0.99
tpcds_q26/datafusion:parquet 90630306 85394710 1.06
tpcds_q27/datafusion:parquet 163706404 160545846 1.02
tpcds_q28/datafusion:parquet 40903858 41910761 0.98
tpcds_q29/datafusion:parquet 106644912 105202121 1.01
tpcds_q30/datafusion:parquet 45269718 45205253 1.00
tpcds_q31/datafusion:parquet 93567136 93177737 1.00
tpcds_q32/datafusion:parquet 24892938 24328489 1.02
tpcds_q33/datafusion:parquet 37838961 38687098 0.98
tpcds_q34/datafusion:parquet 30797073 30516198 1.01
tpcds_q35/datafusion:parquet 89694066 89251521 1.00
tpcds_q36/datafusion:parquet 69992031 69694789 1.00
tpcds_q37/datafusion:parquet 23862952 23728854 1.01
tpcds_q38/datafusion:parquet 57304685 57431403 1.00
tpcds_q39/datafusion:parquet 81596230 81851867 1.00
tpcds_q40/datafusion:parquet 35126576 34235753 1.03
tpcds_q41/datafusion:parquet 19103383 19725006 0.97
tpcds_q42/datafusion:parquet 16435196 16059244 1.02
tpcds_q43/datafusion:parquet 22895108 22914197 1.00
tpcds_q44/datafusion:parquet 40588728 41173047 0.99
tpcds_q45/datafusion:parquet 46685638 44942681 1.04
tpcds_q46/datafusion:parquet 41555770 41625034 1.00
tpcds_q47/datafusion:parquet 154136404 150681157 1.02
tpcds_q48/datafusion:parquet 87711447 88993882 0.99
tpcds_q49/datafusion:parquet 75832914 78548153 0.97
tpcds_q50/datafusion:parquet 73446383 72452472 1.01
tpcds_q51/datafusion:parquet 81227144 82545524 0.98
tpcds_q52/datafusion:parquet 16761072 16544541 1.01
tpcds_q53/datafusion:parquet 24786745 25066360 0.99
tpcds_q54/datafusion:parquet 46555278 47596292 0.98
tpcds_q55/datafusion:parquet 16527299 16824382 0.98
tpcds_q56/datafusion:parquet 36387700 36188293 1.01
tpcds_q57/datafusion:parquet 124721675 123080404 1.01
tpcds_q58/datafusion:parquet 84424000 80615470 1.05
tpcds_q59/datafusion:parquet 75821070 76025026 1.00
tpcds_q60/datafusion:parquet 36833053 36588872 1.01
tpcds_q61/datafusion:parquet 45558244 44963092 1.01
tpcds_q62/datafusion:parquet 34328328 32955549 1.04
tpcds_q63/datafusion:parquet 25074380 24912189 1.01
tpcds_q64/datafusion:parquet 362952715 358256681 1.01
tpcds_q65/datafusion:parquet 48781161 53371189 0.91
tpcds_q66/datafusion:parquet 84837481 86455581 0.98
tpcds_q67/datafusion:parquet 143963256 147397637 0.98
tpcds_q68/datafusion:parquet 41149664 39987588 1.03
tpcds_q69/datafusion:parquet 🚨 90549921 82119973 1.10
tpcds_q70/datafusion:parquet 45371228 44620081 1.02
tpcds_q71/datafusion:parquet 26960194 25798033 1.05
tpcds_q72/datafusion:parquet 442183169 453837572 0.97
tpcds_q73/datafusion:parquet 28079344 27328360 1.03
tpcds_q74/datafusion:parquet 99608410 101322736 0.98
tpcds_q75/datafusion:parquet 172477814 183531290 0.94
tpcds_q76/datafusion:parquet 58118806 62838206 0.92
tpcds_q77/datafusion:parquet 57072402 57470169 0.99
tpcds_q78/datafusion:parquet 123778896 121575988 1.02
tpcds_q79/datafusion:parquet 34203121 34769201 0.98
tpcds_q80/datafusion:parquet 96999277 98549689 0.98
tpcds_q81/datafusion:parquet 40196942 39733412 1.01
tpcds_q82/datafusion:parquet 23581545 23999989 0.98
tpcds_q83/datafusion:parquet 59422246 57580955 1.03
tpcds_q84/datafusion:parquet 46843553 48325784 0.97
tpcds_q85/datafusion:parquet 195551761 195894154 1.00
tpcds_q86/datafusion:parquet 🚀 20849773 23826092 0.88
tpcds_q87/datafusion:parquet 61357057 63085443 0.97
tpcds_q88/datafusion:parquet 59410299 59580270 1.00
tpcds_q89/datafusion:parquet 30746982 30223149 1.02
tpcds_q90/datafusion:parquet 19398078 18652247 1.04
tpcds_q91/datafusion:parquet 66057025 68145598 0.97
tpcds_q92/datafusion:parquet 25524640 24782987 1.03
tpcds_q93/datafusion:parquet 37821942 36817830 1.03
tpcds_q94/datafusion:parquet 30672047 30810944 1.00
tpcds_q95/datafusion:parquet 90148845 89083821 1.01
tpcds_q96/datafusion:parquet 16891048 16477220 1.03
tpcds_q97/datafusion:parquet 39694634 39807281 1.00
tpcds_q98/datafusion:parquet 26607821 27327871 0.97
tpcds_q99/datafusion:parquet 33949504 34875740 0.97
duckdb / vortex-compact / ns (1.007x ➖, 0↑ 6↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 30316195 30031613 1.01
tpcds_q02/duckdb:vortex-compact 31174058 30357495 1.03
tpcds_q03/duckdb:vortex-compact 48991844 44739205 1.10
tpcds_q04/duckdb:vortex-compact 105222540 104018659 1.01
tpcds_q05/duckdb:vortex-compact 48806432 48335783 1.01
tpcds_q06/duckdb:vortex-compact 62014784 61374845 1.01
tpcds_q07/duckdb:vortex-compact 57539024 53359348 1.08
tpcds_q08/duckdb:vortex-compact 94455240 92939502 1.02
tpcds_q09/duckdb:vortex-compact 🚨 26268064 22665735 1.16
tpcds_q10/duckdb:vortex-compact 86074173 87169139 0.99
tpcds_q11/duckdb:vortex-compact 86465948 80541216 1.07
tpcds_q12/duckdb:vortex-compact 21997125 23731946 0.93
tpcds_q13/duckdb:vortex-compact 74608388 75317535 0.99
tpcds_q14/duckdb:vortex-compact 130799058 131962177 0.99
tpcds_q15/duckdb:vortex-compact 40593563 41685401 0.97
tpcds_q16/duckdb:vortex-compact 45081758 48617227 0.93
tpcds_q17/duckdb:vortex-compact 87859927 85570178 1.03
tpcds_q18/duckdb:vortex-compact 68983907 66440161 1.04
tpcds_q19/duckdb:vortex-compact 62945023 64228608 0.98
tpcds_q20/duckdb:vortex-compact 22409085 21992386 1.02
tpcds_q21/duckdb:vortex-compact 26242119 26164940 1.00
tpcds_q22/duckdb:vortex-compact 69593966 69582772 1.00
tpcds_q23/duckdb:vortex-compact 92662163 91940138 1.01
tpcds_q24/duckdb:vortex-compact 73120376 72210114 1.01
tpcds_q25/duckdb:vortex-compact 🚨 87251351 74568431 1.17
tpcds_q26/duckdb:vortex-compact 39994991 39881576 1.00
tpcds_q27/duckdb:vortex-compact 60755568 59703161 1.02
tpcds_q28/duckdb:vortex-compact 🚨 24384093 21509618 1.13
tpcds_q29/duckdb:vortex-compact 82705583 84105472 0.98
tpcds_q30/duckdb:vortex-compact 43049976 45755534 0.94
tpcds_q31/duckdb:vortex-compact 45484751 46635846 0.98
tpcds_q32/duckdb:vortex-compact 25309283 25740175 0.98
tpcds_q33/duckdb:vortex-compact 45110699 45874666 0.98
tpcds_q34/duckdb:vortex-compact 48548822 47333243 1.03
tpcds_q35/duckdb:vortex-compact 113344228 114528335 0.99
tpcds_q36/duckdb:vortex-compact 43627451 43298771 1.01
tpcds_q37/duckdb:vortex-compact 28157958 28399787 0.99
tpcds_q38/duckdb:vortex-compact 52534839 49787384 1.06
tpcds_q39/duckdb:vortex-compact 🚨 39260874 34958499 1.12
tpcds_q40/duckdb:vortex-compact 27035089 26928723 1.00
tpcds_q41/duckdb:vortex-compact 21971909 22548577 0.97
tpcds_q42/duckdb:vortex-compact 27170185 27871578 0.97
tpcds_q43/duckdb:vortex-compact 33864127 35822206 0.95
tpcds_q44/duckdb:vortex-compact 32148067 31761409 1.01
tpcds_q45/duckdb:vortex-compact 46445800 49291835 0.94
tpcds_q46/duckdb:vortex-compact 60389842 62709799 0.96
tpcds_q47/duckdb:vortex-compact 70000742 71262239 0.98
tpcds_q48/duckdb:vortex-compact 67492049 68970071 0.98
tpcds_q49/duckdb:vortex-compact 54409363 53537038 1.02
tpcds_q50/duckdb:vortex-compact 56941561 57586426 0.99
tpcds_q51/duckdb:vortex-compact 116078135 106023588 1.09
tpcds_q52/duckdb:vortex-compact 25857782 24079605 1.07
tpcds_q53/duckdb:vortex-compact 46472233 43834664 1.06
tpcds_q54/duckdb:vortex-compact 56728796 54544783 1.04
tpcds_q55/duckdb:vortex-compact 24166819 26176909 0.92
tpcds_q56/duckdb:vortex-compact 45686567 46683425 0.98
tpcds_q57/duckdb:vortex-compact 50062499 50287756 1.00
tpcds_q58/duckdb:vortex-compact 🚨 52489985 46291193 1.13
tpcds_q59/duckdb:vortex-compact 49762396 49059879 1.01
tpcds_q60/duckdb:vortex-compact 49289648 48661958 1.01
tpcds_q61/duckdb:vortex-compact 65562104 65068669 1.01
tpcds_q62/duckdb:vortex-compact 22176493 23600362 0.94
tpcds_q63/duckdb:vortex-compact 40684295 39965624 1.02
tpcds_q64/duckdb:vortex-compact 171200242 165095534 1.04
tpcds_q65/duckdb:vortex-compact 39590784 39852851 0.99
tpcds_q66/duckdb:vortex-compact 50645007 53999762 0.94
tpcds_q67/duckdb:vortex-compact 142285729 149307384 0.95
tpcds_q68/duckdb:vortex-compact 61674247 61336607 1.01
tpcds_q69/duckdb:vortex-compact 93084915 93246732 1.00
tpcds_q70/duckdb:vortex-compact 66754489 63415296 1.05
tpcds_q71/duckdb:vortex-compact 38094570 37681969 1.01
tpcds_q72/duckdb:vortex-compact 172518525 168211140 1.03
tpcds_q73/duckdb:vortex-compact 43821686 48248261 0.91
tpcds_q74/duckdb:vortex-compact 60214454 61198172 0.98
tpcds_q75/duckdb:vortex-compact 67833989 72255016 0.94
tpcds_q76/duckdb:vortex-compact 32712343 31260598 1.05
tpcds_q77/duckdb:vortex-compact 45038080 46209292 0.97
tpcds_q78/duckdb:vortex-compact 90369290 89532791 1.01
tpcds_q79/duckdb:vortex-compact 75182657 76278440 0.99
tpcds_q80/duckdb:vortex-compact 75446743 81958592 0.92
tpcds_q81/duckdb:vortex-compact 46615659 45631440 1.02
tpcds_q82/duckdb:vortex-compact 64533475 59714033 1.08
tpcds_q83/duckdb:vortex-compact 55104535 52576539 1.05
tpcds_q84/duckdb:vortex-compact 33450749 35761807 0.94
tpcds_q85/duckdb:vortex-compact 78569784 77322904 1.02
tpcds_q86/duckdb:vortex-compact 22539966 21598711 1.04
tpcds_q87/duckdb:vortex-compact 58444808 57662651 1.01
tpcds_q88/duckdb:vortex-compact 113807836 115931459 0.98
tpcds_q89/duckdb:vortex-compact 40831096 42858220 0.95
tpcds_q90/duckdb:vortex-compact 20609777 20805196 0.99
tpcds_q91/duckdb:vortex-compact 76122267 70819370 1.07
tpcds_q92/duckdb:vortex-compact 41431491 43704252 0.95
tpcds_q93/duckdb:vortex-compact 🚨 40216144 34972950 1.15
tpcds_q94/duckdb:vortex-compact 42922984 45316937 0.95
tpcds_q95/duckdb:vortex-compact 158747776 161166480 0.98
tpcds_q96/duckdb:vortex-compact 35214966 37214923 0.95
tpcds_q97/duckdb:vortex-compact 52043795 48132945 1.08
tpcds_q98/duckdb:vortex-compact 34635432 32888780 1.05
tpcds_q99/duckdb:vortex-compact 28921914 30723976 0.94
duckdb / parquet / ns (1.010x ➖, 4↑ 8↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 31740372 32838144 0.97
tpcds_q02/duckdb:parquet 🚨 26930720 22557397 1.19
tpcds_q03/duckdb:parquet 🚨 14224904 12176712 1.17
tpcds_q04/duckdb:parquet 196766468 196741576 1.00
tpcds_q05/duckdb:parquet 34791602 33334205 1.04
tpcds_q06/duckdb:parquet 38693048 36238593 1.07
tpcds_q07/duckdb:parquet 21891563 22044429 0.99
tpcds_q08/duckdb:parquet 34281712 33159581 1.03
tpcds_q09/duckdb:parquet 30433637 30237281 1.01
tpcds_q10/duckdb:parquet 40868236 40723073 1.00
tpcds_q11/duckdb:parquet 101867184 102177647 1.00
tpcds_q12/duckdb:parquet 17729933 18112092 0.98
tpcds_q13/duckdb:parquet 🚨 39983951 34392943 1.16
tpcds_q14/duckdb:parquet 103128490 104506769 0.99
tpcds_q15/duckdb:parquet 35535279 35802612 0.99
tpcds_q16/duckdb:parquet 27408465 27486797 1.00
tpcds_q17/duckdb:parquet 44880701 45471708 0.99
tpcds_q18/duckdb:parquet 56536151 57339683 0.99
tpcds_q19/duckdb:parquet 33411081 33677202 0.99
tpcds_q20/duckdb:parquet 19646714 19352542 1.02
tpcds_q21/duckdb:parquet 13478117 13750851 0.98
tpcds_q22/duckdb:parquet 🚀 51321145 64186012 0.80
tpcds_q23/duckdb:parquet 66838841 67523993 0.99
tpcds_q24/duckdb:parquet 49630875 48769571 1.02
tpcds_q25/duckdb:parquet 41801250 42355904 0.99
tpcds_q26/duckdb:parquet 45702902 45959490 0.99
tpcds_q27/duckdb:parquet 54834032 57809439 0.95
tpcds_q28/duckdb:parquet 28816927 28844719 1.00
tpcds_q29/duckdb:parquet 42681867 42731772 1.00
tpcds_q30/duckdb:parquet 44379489 44069597 1.01
tpcds_q31/duckdb:parquet 29916337 28876524 1.04
tpcds_q32/duckdb:parquet 15399180 15259595 1.01
tpcds_q33/duckdb:parquet 24097071 24109326 1.00
tpcds_q34/duckdb:parquet 21785895 21558686 1.01
tpcds_q35/duckdb:parquet 67600229 67836889 1.00
tpcds_q36/duckdb:parquet 🚨 24374749 22099616 1.10
tpcds_q37/duckdb:parquet 17864579 17934511 1.00
tpcds_q38/duckdb:parquet 40725314 40551300 1.00
tpcds_q39/duckdb:parquet 38057456 37440414 1.02
tpcds_q40/duckdb:parquet 22707210 22918748 0.99
tpcds_q41/duckdb:parquet 10494840 10525274 1.00
tpcds_q42/duckdb:parquet 11661044 11772040 0.99
tpcds_q43/duckdb:parquet 14549442 14588447 1.00
tpcds_q44/duckdb:parquet 24276792 24700431 0.98
tpcds_q45/duckdb:parquet 32939033 32623118 1.01
tpcds_q46/duckdb:parquet 50245749 49763418 1.01
tpcds_q47/duckdb:parquet 49454860 48847535 1.01
tpcds_q48/duckdb:parquet 30571481 30632123 1.00
tpcds_q49/duckdb:parquet 28057687 27974724 1.00
tpcds_q50/duckdb:parquet 27286229 26023473 1.05
tpcds_q51/duckdb:parquet 98344710 97835852 1.01
tpcds_q52/duckdb:parquet 11930970 12271663 0.97
tpcds_q53/duckdb:parquet 🚀 15853418 18035194 0.88
tpcds_q54/duckdb:parquet 29806789 30660340 0.97
tpcds_q55/duckdb:parquet 11929415 11675220 1.02
tpcds_q56/duckdb:parquet 24480628 23947627 1.02
tpcds_q57/duckdb:parquet 42065038 45656815 0.92
tpcds_q58/duckdb:parquet 26570864 27030736 0.98
tpcds_q59/duckdb:parquet 30127254 30579293 0.99
tpcds_q60/duckdb:parquet 25078256 25108494 1.00
tpcds_q61/duckdb:parquet 34094640 31439454 1.08
tpcds_q62/duckdb:parquet 14993264 14769558 1.02
tpcds_q63/duckdb:parquet 15448469 15246747 1.01
tpcds_q64/duckdb:parquet 81143377 79347859 1.02
tpcds_q65/duckdb:parquet 🚨 24255861 21658301 1.12
tpcds_q66/duckdb:parquet 34999731 34613923 1.01
tpcds_q67/duckdb:parquet 🚨 139654187 126099534 1.11
tpcds_q68/duckdb:parquet 40042059 39436216 1.02
tpcds_q69/duckdb:parquet 42297418 41536299 1.02
tpcds_q70/duckdb:parquet 28075267 26249105 1.07
tpcds_q71/duckdb:parquet 22009817 21417506 1.03
tpcds_q72/duckdb:parquet 🚨 188024258 126109095 1.49
tpcds_q73/duckdb:parquet 🚀 18340964 21577041 0.85
tpcds_q74/duckdb:parquet 145867239 147898692 0.99
tpcds_q75/duckdb:parquet 61147187 60132198 1.02
tpcds_q76/duckdb:parquet 19698800 19816894 0.99
tpcds_q77/duckdb:parquet 26078132 24855899 1.05
tpcds_q78/duckdb:parquet 78608714 77087212 1.02
tpcds_q79/duckdb:parquet 🚨 33242859 27861237 1.19
tpcds_q80/duckdb:parquet 46927169 49243376 0.95
tpcds_q81/duckdb:parquet 41000273 41075545 1.00
tpcds_q82/duckdb:parquet 18654861 19624100 0.95
tpcds_q83/duckdb:parquet 22275439 22134525 1.01
tpcds_q84/duckdb:parquet 23395314 23767573 0.98
tpcds_q85/duckdb:parquet 48545139 47890115 1.01
tpcds_q86/duckdb:parquet 14830271 15279341 0.97
tpcds_q87/duckdb:parquet 45238335 43716017 1.03
tpcds_q88/duckdb:parquet 42227822 42781679 0.99
tpcds_q89/duckdb:parquet 19835077 18037226 1.10
tpcds_q90/duckdb:parquet 9678308 10227310 0.95
tpcds_q91/duckdb:parquet 28144317 27570609 1.02
tpcds_q92/duckdb:parquet 15253238 15192260 1.00
tpcds_q93/duckdb:parquet 🚀 31048047 34522310 0.90
tpcds_q94/duckdb:parquet 21534132 21598989 1.00
tpcds_q95/duckdb:parquet 139182055 138991868 1.00
tpcds_q96/duckdb:parquet 9915662 9848430 1.01
tpcds_q97/duckdb:parquet 39290137 38866485 1.01
tpcds_q98/duckdb:parquet 21539635 21389925 1.01
tpcds_q99/duckdb:parquet 23430552 23422841 1.00
File Size Changes (25 files changed, -56.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-file-compressed 53.98 KB 0 B 53.98 KB -100.0%
catalog_page.vortex 1.0 vortex-file-compressed 569.15 KB 0 B 569.15 KB -100.0%
catalog_returns.vortex 1.0 vortex-file-compressed 7.16 MB 0 B 7.16 MB -100.0%
catalog_sales.vortex 1.0 vortex-file-compressed 70.44 MB 0 B 70.44 MB -100.0%
customer.vortex 1.0 vortex-file-compressed 4.20 MB 0 B 4.20 MB -100.0%
customer_address.vortex 1.0 vortex-file-compressed 837.79 KB 0 B 837.79 KB -100.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.49 MB 0 B 1.49 MB -100.0%
date_dim.vortex 1.0 vortex-file-compressed 1.02 MB 0 B 1.02 MB -100.0%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-file-compressed 16.78 KB 0 B 16.78 KB -100.0%
income_band.vortex 1.0 vortex-file-compressed 6.01 KB 0 B 6.01 KB -100.0%
inventory.vortex 1.0 vortex-file-compressed 36.64 MB 0 B 36.64 MB -100.0%
item.vortex 1.0 vortex-file-compressed 1.64 MB 0 B 1.64 MB -100.0%
promotion.vortex 1.0 vortex-file-compressed 60.18 KB 0 B 60.18 KB -100.0%
reason.vortex 1.0 vortex-file-compressed 7.89 KB 0 B 7.89 KB -100.0%
ship_mode.vortex 1.0 vortex-file-compressed 13.54 KB 0 B 13.54 KB -100.0%
store.vortex 1.0 vortex-file-compressed 49.48 KB 0 B 49.48 KB -100.0%
store_returns.vortex 1.0 vortex-file-compressed 10.97 MB 0 B 10.97 MB -100.0%
store_sales.vortex 1.0 vortex-file-compressed 96.33 MB 0 B 96.33 MB -100.0%
time_dim.vortex 1.0 vortex-file-compressed 408.36 KB 0 B 408.36 KB -100.0%
warehouse.vortex 1.0 vortex-file-compressed 24.33 KB 0 B 24.33 KB -100.0%
web_page.vortex 1.0 vortex-file-compressed 30.77 KB 0 B 30.77 KB -100.0%
web_returns.vortex 1.0 vortex-file-compressed 3.55 MB 0 B 3.55 MB -100.0%
web_sales.vortex 1.0 vortex-file-compressed 34.20 MB 0 B 34.20 MB -100.0%
web_site.vortex 1.0 vortex-file-compressed 54.96 KB 0 B 54.96 KB -100.0%

Totals:

  • vortex-compact: 207.95 MB → 207.95 MB (0.0%)
  • vortex-file-compressed: 269.98 MB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +18.4%
Engines: DataFusion No clear signal (-2.4%, environment too noisy confidence) · DuckDB No clear signal (+43.5%, environment too noisy confidence)
Vortex (geomean): 1.095x ➖
Parquet (geomean): 0.925x ➖
Shifts: Parquet (control) -7.5% · Median polish +5.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed / ns (1.077x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 43092823 36946539 1.17
fineweb_q01/datafusion:vortex-file-compressed 514912843 433552258 1.19
fineweb_q02/datafusion:vortex-file-compressed 499136237 435515103 1.15
fineweb_q03/datafusion:vortex-file-compressed 562568047 625095620 0.90
fineweb_q04/datafusion:vortex-file-compressed 460799955 427628721 1.08
fineweb_q05/datafusion:vortex-file-compressed 380635108 400211023 0.95
fineweb_q06/datafusion:vortex-file-compressed 761934318 725736376 1.05
fineweb_q07/datafusion:vortex-file-compressed 582258267 465056295 1.25
fineweb_q08/datafusion:vortex-file-compressed 221437822 218514922 1.01
datafusion / parquet / ns (1.103x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 696113894 618417562 1.13
fineweb_q01/datafusion:parquet 1198519957 971077654 1.23
fineweb_q02/datafusion:parquet 1003713396 1009914775 0.99
fineweb_q03/datafusion:parquet 1042793401 825464665 1.26
fineweb_q04/datafusion:parquet 982472928 908559456 1.08
fineweb_q05/datafusion:parquet 911588967 871777044 1.05
fineweb_q06/datafusion:parquet 911213807 833239667 1.09
fineweb_q07/datafusion:parquet 1000946846 879443081 1.14
fineweb_q08/datafusion:parquet 948491424 962452141 0.99
duckdb / vortex-file-compressed / ns (1.113x ➖, 0↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 49788593 50662101 0.98
fineweb_q01/duckdb:vortex-file-compressed 778466202 618392516 1.26
fineweb_q02/duckdb:vortex-file-compressed 🚨 943927286 517838166 1.82
fineweb_q03/duckdb:vortex-file-compressed 1717598465 1533185736 1.12
fineweb_q04/duckdb:vortex-file-compressed 1825242721 1866635250 0.98
fineweb_q05/duckdb:vortex-file-compressed 1676739250 1741356123 0.96
fineweb_q06/duckdb:vortex-file-compressed 1778323101 1698886782 1.05
fineweb_q07/duckdb:vortex-file-compressed 1594092642 1564219949 1.02
fineweb_q08/duckdb:vortex-file-compressed 703676560 679323162 1.04
duckdb / parquet / ns (0.776x ➖, 1↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚀 551925688 5250555728 0.11
fineweb_q01/duckdb:parquet 5326285548 5316482314 1.00
fineweb_q02/duckdb:parquet 5296109882 5353213420 0.99
fineweb_q03/duckdb:parquet 5331100642 5370862675 0.99
fineweb_q04/duckdb:parquet 5300420993 5311070241 1.00
fineweb_q05/duckdb:parquet 5287584053 5307763594 1.00
fineweb_q06/duckdb:parquet 5420071488 5422725988 1.00
fineweb_q07/duckdb:parquet 5301590703 5340058417 0.99
fineweb_q08/duckdb:parquet 5256143199 5260022130 1.00

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.009x ➖

datafusion / vortex-file-compressed / ns (1.009x ➖, 0↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚨 132033398 114114963 1.16
polarsignals_q01/datafusion:vortex-file-compressed 161155590 165686410 0.97
polarsignals_q02/datafusion:vortex-file-compressed 21041307 22256105 0.95
polarsignals_q03/datafusion:vortex-file-compressed 161835010 164445613 0.98
polarsignals_q04/datafusion:vortex-file-compressed 10726922 10744690 1.00
polarsignals_q05/datafusion:vortex-file-compressed 13638794 13569312 1.01
polarsignals_q06/datafusion:vortex-file-compressed 22074174 21388746 1.03
polarsignals_q07/datafusion:vortex-file-compressed 12166851 11583728 1.05
polarsignals_q08/datafusion:vortex-file-compressed 270496829 275073004 0.98
polarsignals_q09/datafusion:vortex-file-compressed 11013382 11252955 0.98

No file size changes detected.

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (+1.6%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): 1.009x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed / ns (1.011x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 43857707 45101622 0.97
tpch_q02/datafusion:vortex-file-compressed 22601735 22867806 0.99
tpch_q03/datafusion:vortex-file-compressed 29849490 30784196 0.97
tpch_q04/datafusion:vortex-file-compressed 16128461 15694245 1.03
tpch_q05/datafusion:vortex-file-compressed 50427989 49884021 1.01
tpch_q06/datafusion:vortex-file-compressed 8389655 8204672 1.02
tpch_q07/datafusion:vortex-file-compressed 57457209 56392537 1.02
tpch_q08/datafusion:vortex-file-compressed 45788450 45436123 1.01
tpch_q09/datafusion:vortex-file-compressed 56789262 55758497 1.02
tpch_q10/datafusion:vortex-file-compressed 29283296 28305981 1.03
tpch_q11/datafusion:vortex-file-compressed 17734620 17499294 1.01
tpch_q12/datafusion:vortex-file-compressed 28101660 27758219 1.01
tpch_q13/datafusion:vortex-file-compressed 24665966 25109487 0.98
tpch_q14/datafusion:vortex-file-compressed 15222352 14951234 1.02
tpch_q15/datafusion:vortex-file-compressed 21209849 21497395 0.99
tpch_q16/datafusion:vortex-file-compressed 25361965 24442103 1.04
tpch_q17/datafusion:vortex-file-compressed 56428974 55187571 1.02
tpch_q18/datafusion:vortex-file-compressed 67948655 68770665 0.99
tpch_q19/datafusion:vortex-file-compressed 19566285 19005185 1.03
tpch_q20/datafusion:vortex-file-compressed 33020562 31972207 1.03
tpch_q21/datafusion:vortex-file-compressed 62726721 62426266 1.00
tpch_q22/datafusion:vortex-file-compressed 12459088 11991239 1.04
datafusion / parquet / ns (0.994x ➖, 1↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 112533665 127729161 0.88
tpch_q02/datafusion:parquet 70964157 71870663 0.99
tpch_q03/datafusion:parquet 97342137 94687538 1.03
tpch_q04/datafusion:parquet 51449411 49409631 1.04
tpch_q05/datafusion:parquet 128186403 128624959 1.00
tpch_q06/datafusion:parquet 39353048 42762459 0.92
tpch_q07/datafusion:parquet 127956592 134568041 0.95
tpch_q08/datafusion:parquet 124612035 119458081 1.04
tpch_q09/datafusion:parquet 156070776 160259327 0.97
tpch_q10/datafusion:parquet 120868584 122276551 0.99
tpch_q11/datafusion:parquet 50627156 51302789 0.99
tpch_q12/datafusion:parquet 105173495 101849787 1.03
tpch_q13/datafusion:parquet 226444754 220884390 1.03
tpch_q14/datafusion:parquet 52269377 50037596 1.04
tpch_q15/datafusion:parquet 71356456 70118920 1.02
tpch_q16/datafusion:parquet 49895632 50196809 0.99
tpch_q17/datafusion:parquet 155724533 150471778 1.03
tpch_q18/datafusion:parquet 183958148 181941476 1.01
tpch_q19/datafusion:parquet 84517792 87019952 0.97
tpch_q20/datafusion:parquet 88911477 94422855 0.94
tpch_q21/datafusion:parquet 175547144 169596113 1.04
tpch_q22/datafusion:parquet 55708133 56340454 0.99
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 28844393 24494704 1.18
tpch_q02/duckdb:vortex-file-compressed 35643139 37448685 0.95
tpch_q03/duckdb:vortex-file-compressed 41819271 40720230 1.03
tpch_q04/duckdb:vortex-file-compressed 33119850 34722217 0.95
tpch_q05/duckdb:vortex-file-compressed 47356425 46376532 1.02
tpch_q06/duckdb:vortex-file-compressed 13265702 14526765 0.91
tpch_q07/duckdb:vortex-file-compressed 45906566 45735845 1.00
tpch_q08/duckdb:vortex-file-compressed 54921286 55824018 0.98
tpch_q09/duckdb:vortex-file-compressed 63851902 65353254 0.98
tpch_q10/duckdb:vortex-file-compressed 56933076 55301847 1.03
tpch_q11/duckdb:vortex-file-compressed 19043604 19589601 0.97
tpch_q12/duckdb:vortex-file-compressed 32503673 30985900 1.05
tpch_q13/duckdb:vortex-file-compressed 46932088 47105434 1.00
tpch_q14/duckdb:vortex-file-compressed 24576307 26323376 0.93
tpch_q15/duckdb:vortex-file-compressed 22323506 21125366 1.06
tpch_q16/duckdb:vortex-file-compressed 33834571 33427171 1.01
tpch_q17/duckdb:vortex-file-compressed 35745442 36186197 0.99
tpch_q18/duckdb:vortex-file-compressed 55295785 53976006 1.02
tpch_q19/duckdb:vortex-file-compressed 43153848 40747558 1.06
tpch_q20/duckdb:vortex-file-compressed 41842508 41522617 1.01
tpch_q21/duckdb:vortex-file-compressed 132435530 128524181 1.03
tpch_q22/duckdb:vortex-file-compressed 22916547 22517633 1.02
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 81648880 81703164 1.00
tpch_q02/duckdb:parquet 46487063 46303142 1.00
tpch_q03/duckdb:parquet 80917459 80774734 1.00
tpch_q04/duckdb:parquet 57980074 57814924 1.00
tpch_q05/duckdb:parquet 79162071 79109934 1.00
tpch_q06/duckdb:parquet 25220541 24893006 1.01
tpch_q07/duckdb:parquet 80629546 80002742 1.01
tpch_q08/duckdb:parquet 96606513 96851977 1.00
tpch_q09/duckdb:parquet 148513051 148641082 1.00
tpch_q10/duckdb:parquet 142021908 141971055 1.00
tpch_q11/duckdb:parquet 25686793 25580486 1.00
tpch_q12/duckdb:parquet 53809730 53129240 1.01
tpch_q13/duckdb:parquet 289014981 289047740 1.00
tpch_q14/duckdb:parquet 56106587 55991957 1.00
tpch_q15/duckdb:parquet 30688031 30770166 1.00
tpch_q16/duckdb:parquet 67150793 65809394 1.02
tpch_q17/duckdb:parquet 58094552 57679935 1.01
tpch_q18/duckdb:parquet 128392383 128016637 1.00
tpch_q19/duckdb:parquet 78021670 78245521 1.00
tpch_q20/duckdb:parquet 77452858 77807137 1.00
tpch_q21/duckdb:parquet 190777511 191615679 1.00
tpch_q22/duckdb:parquet 64021350 64362282 0.99
File Size Changes (9 files changed, -43.9% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-compact 7.40 MB 0 B 7.40 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 1.0 vortex-compact 126.00 MB 0 B 126.00 MB -100.0%
nation.vortex 1.0 vortex-compact 8.04 KB 0 B 8.04 KB -100.0%
orders.vortex 1.0 vortex-compact 31.73 MB 0 B 31.73 MB -100.0%
part.vortex 1.0 vortex-compact 3.55 MB 0 B 3.55 MB -100.0%
partsupp.vortex 1.0 vortex-compact 20.29 MB 0 B 20.29 MB -100.0%
region.vortex 1.0 vortex-compact 6.09 KB 0 B 6.09 KB -100.0%
supplier.vortex 1.0 vortex-compact 496.71 KB 0 B 496.71 KB -100.0%

Totals:

  • vortex-compact: 189.73 MB → 0 B (-100.0%)
  • vortex-file-compressed: 242.85 MB → 242.85 MB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (+2.6%, environment too noisy confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): 1.004x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish +1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed / ns (0.990x ➖, 1↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 262300607 265046413 0.99
tpch_q02/datafusion:vortex-file-compressed 437538818 449648003 0.97
tpch_q03/datafusion:vortex-file-compressed 334969308 340112752 0.98
tpch_q04/datafusion:vortex-file-compressed 176742322 170306221 1.04
tpch_q05/datafusion:vortex-file-compressed 322531000 326755233 0.99
tpch_q06/datafusion:vortex-file-compressed 269557942 257962937 1.04
tpch_q07/datafusion:vortex-file-compressed 345720361 358316294 0.96
tpch_q08/datafusion:vortex-file-compressed 465652529 500669332 0.93
tpch_q09/datafusion:vortex-file-compressed 317653988 292889551 1.08
tpch_q10/datafusion:vortex-file-compressed 383524418 363694539 1.05
tpch_q11/datafusion:vortex-file-compressed 273741239 286471913 0.96
tpch_q12/datafusion:vortex-file-compressed 🚀 334733988 529534393 0.63
tpch_q13/datafusion:vortex-file-compressed 132470498 113429371 1.17
tpch_q14/datafusion:vortex-file-compressed 201197743 208405852 0.97
tpch_q15/datafusion:vortex-file-compressed 364175816 355079448 1.03
tpch_q16/datafusion:vortex-file-compressed 202238292 207566049 0.97
tpch_q17/datafusion:vortex-file-compressed 349007622 329781270 1.06
tpch_q18/datafusion:vortex-file-compressed 266556802 255367065 1.04
tpch_q19/datafusion:vortex-file-compressed 399319309 361701303 1.10
tpch_q20/datafusion:vortex-file-compressed 388629136 361979653 1.07
tpch_q21/datafusion:vortex-file-compressed 440895569 449663237 0.98
tpch_q22/datafusion:vortex-file-compressed 138254048 157498885 0.88
datafusion / parquet / ns (0.965x ➖, 1↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 234056851 228593349 1.02
tpch_q02/datafusion:parquet 273835699 314225398 0.87
tpch_q03/datafusion:parquet 303966447 349308207 0.87
tpch_q04/datafusion:parquet 175713534 175433869 1.00
tpch_q05/datafusion:parquet 381342884 482717389 0.79
tpch_q06/datafusion:parquet 🚀 158917911 233136290 0.68
tpch_q07/datafusion:parquet 441618857 414226630 1.07
tpch_q08/datafusion:parquet 506902797 475929061 1.07
tpch_q09/datafusion:parquet 478831519 460322233 1.04
tpch_q10/datafusion:parquet 431924580 426686557 1.01
tpch_q11/datafusion:parquet 276333116 283810129 0.97
tpch_q12/datafusion:parquet 211435826 218681919 0.97
tpch_q13/datafusion:parquet 456633462 457887715 1.00
tpch_q14/datafusion:parquet 179220208 191388905 0.94
tpch_q15/datafusion:parquet 296691668 313676498 0.95
tpch_q16/datafusion:parquet 127047022 150245027 0.85
tpch_q17/datafusion:parquet 316344054 343690783 0.92
tpch_q18/datafusion:parquet 463527386 486653797 0.95
tpch_q19/datafusion:parquet 193735345 201061906 0.96
tpch_q20/datafusion:parquet 290101585 288366046 1.01
tpch_q21/datafusion:parquet 567804698 447234461 1.27
tpch_q22/datafusion:parquet 249949764 210233291 1.19
duckdb / vortex-file-compressed / ns (1.018x ➖, 0↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 252023992 254103270 0.99
tpch_q02/duckdb:vortex-file-compressed 629778033 597754705 1.05
tpch_q03/duckdb:vortex-file-compressed 483072939 468112063 1.03
tpch_q04/duckdb:vortex-file-compressed 301884384 274249742 1.10
tpch_q05/duckdb:vortex-file-compressed 635282961 547113988 1.16
tpch_q06/duckdb:vortex-file-compressed 303894170 289346928 1.05
tpch_q07/duckdb:vortex-file-compressed 580254531 593315167 0.98
tpch_q08/duckdb:vortex-file-compressed 811217613 773504062 1.05
tpch_q09/duckdb:vortex-file-compressed 562690123 583943285 0.96
tpch_q10/duckdb:vortex-file-compressed 503552692 484423423 1.04
tpch_q11/duckdb:vortex-file-compressed 284833006 268658014 1.06
tpch_q12/duckdb:vortex-file-compressed 🚨 553174831 410103436 1.35
tpch_q13/duckdb:vortex-file-compressed 303894551 312394606 0.97
tpch_q14/duckdb:vortex-file-compressed 258153250 249871258 1.03
tpch_q15/duckdb:vortex-file-compressed 168155588 174580631 0.96
tpch_q16/duckdb:vortex-file-compressed 237625216 235054799 1.01
tpch_q17/duckdb:vortex-file-compressed 461411639 573437711 0.80
tpch_q18/duckdb:vortex-file-compressed 368131246 355174771 1.04
tpch_q19/duckdb:vortex-file-compressed 406586389 382805842 1.06
tpch_q20/duckdb:vortex-file-compressed 585783653 562026358 1.04
tpch_q21/duckdb:vortex-file-compressed 796709361 820091399 0.97
tpch_q22/duckdb:vortex-file-compressed 149877728 187383872 0.80
duckdb / parquet / ns (1.029x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 348865384 338336176 1.03
tpch_q02/duckdb:parquet 676023638 683154816 0.99
tpch_q03/duckdb:parquet 914053883 861257877 1.06
tpch_q04/duckdb:parquet 495143143 475607610 1.04
tpch_q05/duckdb:parquet 1020674757 973363473 1.05
tpch_q06/duckdb:parquet 349400043 312210562 1.12
tpch_q07/duckdb:parquet 938242825 909760376 1.03
tpch_q08/duckdb:parquet 1183373924 1164649595 1.02
tpch_q09/duckdb:parquet 1100937981 1110793335 0.99
tpch_q10/duckdb:parquet 1057015821 1083231900 0.98
tpch_q11/duckdb:parquet 461111835 470146466 0.98
tpch_q12/duckdb:parquet 633901952 563829165 1.12
tpch_q13/duckdb:parquet 869963087 863577918 1.01
tpch_q14/duckdb:parquet 540389386 521228110 1.04
tpch_q15/duckdb:parquet 415983124 399149146 1.04
tpch_q16/duckdb:parquet 514635157 518182722 0.99
tpch_q17/duckdb:parquet 513267966 511109032 1.00
tpch_q18/duckdb:parquet 687324728 674106782 1.02
tpch_q19/duckdb:parquet 660749548 630713050 1.05
tpch_q20/duckdb:parquet 939897251 860539135 1.09
tpch_q21/duckdb:parquet 814089832 756904802 1.08
tpch_q22/duckdb:parquet 425722461 455221658 0.94

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): 1.005x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed / ns (0.996x ➖, 1↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 8414291 8557549 0.98
fineweb_q01/datafusion:vortex-file-compressed 30435600 30043869 1.01
fineweb_q02/datafusion:vortex-file-compressed 32736445 33134836 0.99
fineweb_q03/datafusion:vortex-file-compressed 43594959 40356148 1.08
fineweb_q04/datafusion:vortex-file-compressed 209965383 205379850 1.02
fineweb_q05/datafusion:vortex-file-compressed 152950321 156204469 0.98
fineweb_q06/datafusion:vortex-file-compressed 37825360 38431149 0.98
fineweb_q07/datafusion:vortex-file-compressed 45157898 43000006 1.05
fineweb_q08/datafusion:vortex-file-compressed 🚀 15138444 17254797 0.88
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 8390598 8833445 0.95
fineweb_q01/datafusion:parquet 193992825 197095030 0.98
fineweb_q02/datafusion:parquet 199316474 195168752 1.02
fineweb_q03/datafusion:parquet 192081739 192195481 1.00
fineweb_q04/datafusion:parquet 208123757 207334025 1.00
fineweb_q05/datafusion:parquet 206563406 204021292 1.01
fineweb_q06/datafusion:parquet 198114785 198024577 1.00
fineweb_q07/datafusion:parquet 190395466 191713668 0.99
fineweb_q08/datafusion:parquet 187832342 188533725 1.00
duckdb / vortex-file-compressed / ns (1.015x ➖, 2↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 8294983 5445283 1.52
fineweb_q01/duckdb:vortex-file-compressed 39968129 42562805 0.94
fineweb_q02/duckdb:vortex-file-compressed 47307684 48176893 0.98
fineweb_q03/duckdb:vortex-file-compressed 🚀 67903484 76998998 0.88
fineweb_q04/duckdb:vortex-file-compressed 290636009 300461067 0.97
fineweb_q05/duckdb:vortex-file-compressed 241210260 222817879 1.08
fineweb_q06/duckdb:vortex-file-compressed 79391416 76813746 1.03
fineweb_q07/duckdb:vortex-file-compressed 79340372 83289877 0.95
fineweb_q08/duckdb:vortex-file-compressed 🚀 32390625 36317632 0.89
duckdb / parquet / ns (1.008x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 37932735 37437436 1.01
fineweb_q01/duckdb:parquet 78054972 76630109 1.02
fineweb_q02/duckdb:parquet 78784295 75410758 1.04
fineweb_q03/duckdb:parquet 207161537 206647027 1.00
fineweb_q04/duckdb:parquet 232179703 230884972 1.01
fineweb_q05/duckdb:parquet 202136551 201340775 1.00
fineweb_q06/duckdb:parquet 142309118 141606904 1.00
fineweb_q07/duckdb:parquet 143692530 143874816 1.00
fineweb_q08/duckdb:parquet 38394007 39039132 0.98
File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.9%
Engines: DuckDB No clear signal (+1.9%, low confidence)
Vortex (geomean): 1.026x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish +2.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed / ns (1.026x ➖, 2↑ 4↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 🚨 16772284 15153786 1.11
statpopgen_q01/duckdb:vortex-file-compressed 🚨 14618154 13162082 1.11
statpopgen_q02/duckdb:vortex-file-compressed 🚨 638855077 565019478 1.13
statpopgen_q03/duckdb:vortex-file-compressed 1198259128 1191024683 1.01
statpopgen_q04/duckdb:vortex-file-compressed 🚨 1708955341 1218303099 1.40
statpopgen_q05/duckdb:vortex-file-compressed 546071898 540346777 1.01
statpopgen_q06/duckdb:vortex-file-compressed 🚀 1843014006 2261357253 0.82
statpopgen_q07/duckdb:vortex-file-compressed 264856757 253627416 1.04
statpopgen_q08/duckdb:vortex-file-compressed 275044184 273390705 1.01
statpopgen_q09/duckdb:vortex-file-compressed 999092030 954575854 1.05
statpopgen_q10/duckdb:vortex-file-compressed 🚀 3147869116 4208432383 0.75
duckdb / parquet / ns (1.007x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 377009794 376706920 1.00
statpopgen_q01/duckdb:parquet 468447094 466673811 1.00
statpopgen_q02/duckdb:parquet 783084117 777062783 1.01
statpopgen_q03/duckdb:parquet 1068411896 1048015644 1.02
statpopgen_q04/duckdb:parquet 1059956483 1047336126 1.01
statpopgen_q05/duckdb:parquet 775497891 765486453 1.01
statpopgen_q06/duckdb:parquet 1018110129 1019247918 1.00
statpopgen_q07/duckdb:parquet 958309254 962625831 1.00
statpopgen_q08/duckdb:parquet 964441342 970945718 0.99
statpopgen_q09/duckdb:parquet 1015291332 1000607468 1.01
statpopgen_q10/duckdb:parquet 1682337862 1645344041 1.02
File Size Changes (2 files changed, -32.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.66 MB 0 B 960.66 MB -100.0%

Totals:

  • vortex-compact: 960.92 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.4%
Engines: DataFusion No clear signal (-1.7%, low confidence) · DuckDB No clear signal (-1.1%, low confidence)
Vortex (geomean): 0.987x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed / ns (0.984x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 354391177 351235079 1.01
tpch_q02/datafusion:vortex-file-compressed 101753525 102058237 1.00
tpch_q03/datafusion:vortex-file-compressed 156919005 160520480 0.98
tpch_q04/datafusion:vortex-file-compressed 69350381 70811711 0.98
tpch_q05/datafusion:vortex-file-compressed 275155069 277313018 0.99
tpch_q06/datafusion:vortex-file-compressed 27109754 27993086 0.97
tpch_q07/datafusion:vortex-file-compressed 369735407 372494395 0.99
tpch_q08/datafusion:vortex-file-compressed 289176747 289110674 1.00
tpch_q09/datafusion:vortex-file-compressed 482962045 489417831 0.99
tpch_q10/datafusion:vortex-file-compressed 181024606 185123027 0.98
tpch_q11/datafusion:vortex-file-compressed 73483939 80343348 0.91
tpch_q12/datafusion:vortex-file-compressed 86267700 87471316 0.99
tpch_q13/datafusion:vortex-file-compressed 120081418 118612208 1.01
tpch_q14/datafusion:vortex-file-compressed 42236513 42399838 1.00
tpch_q15/datafusion:vortex-file-compressed 74789465 74600867 1.00
tpch_q16/datafusion:vortex-file-compressed 69473908 68500875 1.01
tpch_q17/datafusion:vortex-file-compressed 426453440 430582000 0.99
tpch_q18/datafusion:vortex-file-compressed 612932606 633702585 0.97
tpch_q19/datafusion:vortex-file-compressed 63773382 68365385 0.93
tpch_q20/datafusion:vortex-file-compressed 137765185 139712085 0.99
tpch_q21/datafusion:vortex-file-compressed 473218918 483145551 0.98
tpch_q22/datafusion:vortex-file-compressed 41455337 41751309 0.99
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 320775827 320010544 1.00
tpch_q02/datafusion:parquet 221552329 216608177 1.02
tpch_q03/datafusion:parquet 233648822 232561984 1.00
tpch_q04/datafusion:parquet 99762204 99026015 1.01
tpch_q05/datafusion:parquet 359958583 360004021 1.00
tpch_q06/datafusion:parquet 74385421 75268029 0.99
tpch_q07/datafusion:parquet 513767278 522736494 0.98
tpch_q08/datafusion:parquet 404152890 411577696 0.98
tpch_q09/datafusion:parquet 666311881 665684021 1.00
tpch_q10/datafusion:parquet 541516275 557282599 0.97
tpch_q11/datafusion:parquet 164471230 160252754 1.03
tpch_q12/datafusion:parquet 150115809 156751848 0.96
tpch_q13/datafusion:parquet 350878614 349590801 1.00
tpch_q14/datafusion:parquet 121818608 119866179 1.02
tpch_q15/datafusion:parquet 192428588 195184954 0.99
tpch_q16/datafusion:parquet 144873430 142779785 1.01
tpch_q17/datafusion:parquet 509780036 508648914 1.00
tpch_q18/datafusion:parquet 711928252 695425167 1.02
tpch_q19/datafusion:parquet 211001541 205910981 1.02
tpch_q20/datafusion:parquet 306728352 307535207 1.00
tpch_q21/datafusion:parquet 550407148 540587959 1.02
tpch_q22/datafusion:parquet 255471597 259055433 0.99
duckdb / vortex-file-compressed / ns (0.990x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 90496107 90006727 1.01
tpch_q02/duckdb:vortex-file-compressed 73561176 73083658 1.01
tpch_q03/duckdb:vortex-file-compressed 142797894 143640607 0.99
tpch_q04/duckdb:vortex-file-compressed 168722343 169109870 1.00
tpch_q05/duckdb:vortex-file-compressed 151500800 154440525 0.98
tpch_q06/duckdb:vortex-file-compressed 39478490 40602325 0.97
tpch_q07/duckdb:vortex-file-compressed 140253714 139776300 1.00
tpch_q08/duckdb:vortex-file-compressed 184446333 183483363 1.01
tpch_q09/duckdb:vortex-file-compressed 314274404 314734709 1.00
tpch_q10/duckdb:vortex-file-compressed 220785282 223692914 0.99
tpch_q11/duckdb:vortex-file-compressed 40388196 42327708 0.95
tpch_q12/duckdb:vortex-file-compressed 116681248 118201523 0.99
tpch_q13/duckdb:vortex-file-compressed 174259153 173142320 1.01
tpch_q14/duckdb:vortex-file-compressed 58507093 59934656 0.98
tpch_q15/duckdb:vortex-file-compressed 93066139 92359286 1.01
tpch_q16/duckdb:vortex-file-compressed 83702737 83572785 1.00
tpch_q17/duckdb:vortex-file-compressed 106794591 110002793 0.97
tpch_q18/duckdb:vortex-file-compressed 254814782 258727447 0.98
tpch_q19/duckdb:vortex-file-compressed 84441246 86183903 0.98
tpch_q20/duckdb:vortex-file-compressed 149691148 150603626 0.99
tpch_q21/duckdb:vortex-file-compressed 489783538 490713611 1.00
tpch_q22/duckdb:vortex-file-compressed 77717789 80538292 0.96
duckdb / parquet / ns (1.001x ➖, 0↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 143413761 127435698 1.13
tpch_q02/duckdb:parquet 101657653 100795813 1.01
tpch_q03/duckdb:parquet 164057152 166929861 0.98
tpch_q04/duckdb:parquet 117047714 122403660 0.96
tpch_q05/duckdb:parquet 184830753 186578193 0.99
tpch_q06/duckdb:parquet 55473771 59432753 0.93
tpch_q07/duckdb:parquet 144558247 143348161 1.01
tpch_q08/duckdb:parquet 223524376 218877989 1.02
tpch_q09/duckdb:parquet 347540118 348443266 1.00
tpch_q10/duckdb:parquet 653875787 660531928 0.99
tpch_q11/duckdb:parquet 41488246 41660068 1.00
tpch_q12/duckdb:parquet 119617942 117717568 1.02
tpch_q13/duckdb:parquet 397579038 401606516 0.99
tpch_q14/duckdb:parquet 154022701 150156319 1.03
tpch_q15/duckdb:parquet 76863617 78033995 0.99
tpch_q16/duckdb:parquet 155714580 154862112 1.01
tpch_q17/duckdb:parquet 125156145 116677571 1.07
tpch_q18/duckdb:parquet 296992201 296423758 1.00
tpch_q19/duckdb:parquet 231321998 242554102 0.95
tpch_q20/duckdb:parquet 195783277 197671071 0.99
tpch_q21/duckdb:parquet 435127771 442118121 0.98
tpch_q22/duckdb:parquet 335566679 336297779 1.00
File Size Changes (9 files changed, -44.0% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 10.0 vortex-compact 74.00 MB 0 B 74.00 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 10.0 vortex-compact 1.28 GB 0 B 1.28 GB -100.0%
nation.vortex 10.0 vortex-compact 8.04 KB 0 B 8.04 KB -100.0%
orders.vortex 10.0 vortex-compact 344.31 MB 0 B 344.31 MB -100.0%
part.vortex 10.0 vortex-compact 35.89 MB 0 B 35.89 MB -100.0%
partsupp.vortex 10.0 vortex-compact 203.66 MB 0 B 203.66 MB -100.0%
region.vortex 10.0 vortex-compact 6.09 KB 0 B 6.09 KB -100.0%
supplier.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.92 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (+2.3%, low confidence)
Vortex (geomean): 1.010x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed / ns (0.999x ➖, 1↑ 2↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 2054841 2018803 1.02
clickbench_q01/datafusion:vortex-file-compressed 11680293 11546781 1.01
clickbench_q02/datafusion:vortex-file-compressed 23160381 22409379 1.03
clickbench_q03/datafusion:vortex-file-compressed 25796220 25383678 1.02
clickbench_q04/datafusion:vortex-file-compressed 159455509 161020340 0.99
clickbench_q05/datafusion:vortex-file-compressed 211745823 212413290 1.00
clickbench_q06/datafusion:vortex-file-compressed 1995510 2005124 1.00
clickbench_q07/datafusion:vortex-file-compressed 14639716 14847704 0.99
clickbench_q08/datafusion:vortex-file-compressed 225150316 222231995 1.01
clickbench_q09/datafusion:vortex-file-compressed 357617888 356935388 1.00
clickbench_q10/datafusion:vortex-file-compressed 51911044 50121806 1.04
clickbench_q11/datafusion:vortex-file-compressed 58688940 58252270 1.01
clickbench_q12/datafusion:vortex-file-compressed 194221239 194539251 1.00
clickbench_q13/datafusion:vortex-file-compressed 332658806 335063147 0.99
clickbench_q14/datafusion:vortex-file-compressed 206047934 198842064 1.04
clickbench_q15/datafusion:vortex-file-compressed 196794949 196454002 1.00
clickbench_q16/datafusion:vortex-file-compressed 472027707 483860940 0.98
clickbench_q17/datafusion:vortex-file-compressed 471832962 459117885 1.03
clickbench_q18/datafusion:vortex-file-compressed 927572611 918866112 1.01
clickbench_q19/datafusion:vortex-file-compressed 17370604 17658196 0.98
clickbench_q20/datafusion:vortex-file-compressed 203633191 194092597 1.05
clickbench_q21/datafusion:vortex-file-compressed 266920406 260998165 1.02
clickbench_q22/datafusion:vortex-file-compressed 342486386 333076440 1.03
clickbench_q23/datafusion:vortex-file-compressed 427110319 467552886 0.91
clickbench_q24/datafusion:vortex-file-compressed 35873442 36424615 0.98
clickbench_q25/datafusion:vortex-file-compressed 47417980 49592237 0.96
clickbench_q26/datafusion:vortex-file-compressed 38864446 38494884 1.01
clickbench_q27/datafusion:vortex-file-compressed 285390248 281814620 1.01
clickbench_q28/datafusion:vortex-file-compressed 1432077860 1461217806 0.98
clickbench_q29/datafusion:vortex-file-compressed 🚀 41432043 57080642 0.73
clickbench_q30/datafusion:vortex-file-compressed 161221068 163094950 0.99
clickbench_q31/datafusion:vortex-file-compressed 193977906 190105706 1.02
clickbench_q32/datafusion:vortex-file-compressed 825749271 826411390 1.00
clickbench_q33/datafusion:vortex-file-compressed 999564303 1048301432 0.95
clickbench_q34/datafusion:vortex-file-compressed 1026378826 1029956197 1.00
clickbench_q35/datafusion:vortex-file-compressed 159750300 174375960 0.92
clickbench_q36/datafusion:vortex-file-compressed 62211938 67066596 0.93
clickbench_q37/datafusion:vortex-file-compressed 🚨 34106007 29480002 1.16
clickbench_q38/datafusion:vortex-file-compressed 16488883 15977087 1.03
clickbench_q39/datafusion:vortex-file-compressed 134428150 134414536 1.00
clickbench_q40/datafusion:vortex-file-compressed 12876450 13613402 0.95
clickbench_q41/datafusion:vortex-file-compressed 🚨 16440995 12197543 1.35
clickbench_q42/datafusion:vortex-file-compressed 13670200 13787432 0.99
datafusion / parquet / ns (1.008x ➖, 1↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1950477 1956614 1.00
clickbench_q01/datafusion:parquet 18044925 18007506 1.00
clickbench_q02/datafusion:parquet 33865787 31237920 1.08
clickbench_q03/datafusion:parquet 25439247 26254277 0.97
clickbench_q04/datafusion:parquet 178653962 173838396 1.03
clickbench_q05/datafusion:parquet 235165313 243201268 0.97
clickbench_q06/datafusion:parquet 1938873 1968377 0.99
clickbench_q07/datafusion:parquet 18543075 18489507 1.00
clickbench_q08/datafusion:parquet 232591720 233413399 1.00
clickbench_q09/datafusion:parquet 376511928 385553052 0.98
clickbench_q10/datafusion:parquet 72645988 71573128 1.01
clickbench_q11/datafusion:parquet 92586041 91839814 1.01
clickbench_q12/datafusion:parquet 235165011 241926069 0.97
clickbench_q13/datafusion:parquet 398804558 391238151 1.02
clickbench_q14/datafusion:parquet 256177839 257430516 1.00
clickbench_q15/datafusion:parquet 197932165 192626926 1.03
clickbench_q16/datafusion:parquet 492134933 477080206 1.03
clickbench_q17/datafusion:parquet 480370407 474701254 1.01
clickbench_q18/datafusion:parquet 929436361 927571350 1.00
clickbench_q19/datafusion:parquet 🚨 27399699 23392464 1.17
clickbench_q20/datafusion:parquet 458031568 481072719 0.95
clickbench_q21/datafusion:parquet 503234810 487900992 1.03
clickbench_q22/datafusion:parquet 648957113 653429294 0.99
clickbench_q23/datafusion:parquet 2912072369 2858509837 1.02
clickbench_q24/datafusion:parquet 50660657 53819340 0.94
clickbench_q25/datafusion:parquet 96145121 96812813 0.99
clickbench_q26/datafusion:parquet 49517132 48291144 1.03
clickbench_q27/datafusion:parquet 529243998 525348752 1.01
clickbench_q28/datafusion:parquet 1542034291 1553705619 0.99
clickbench_q29/datafusion:parquet 43301427 41718042 1.04
clickbench_q30/datafusion:parquet 237929378 242787991 0.98
clickbench_q31/datafusion:parquet 275202809 275304444 1.00
clickbench_q32/datafusion:parquet 849859603 852235844 1.00
clickbench_q33/datafusion:parquet 1103138360 1083833676 1.02
clickbench_q34/datafusion:parquet 1085298669 1088487653 1.00
clickbench_q35/datafusion:parquet 181545155 166809181 1.09
clickbench_q36/datafusion:parquet 🚀 116093903 129160406 0.90
clickbench_q37/datafusion:parquet 53222695 48936905 1.09
clickbench_q38/datafusion:parquet 73279853 69057801 1.06
clickbench_q39/datafusion:parquet 230348272 228660920 1.01
clickbench_q40/datafusion:parquet 26902463 26734695 1.01
clickbench_q41/datafusion:parquet 24738055 24441245 1.01
clickbench_q42/datafusion:parquet 25313529 25818147 0.98
duckdb / vortex-file-compressed / ns (1.021x ➖, 1↑ 7↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 11238256 12719030 0.88
clickbench_q01/duckdb:vortex-file-compressed 20308440 21120488 0.96
clickbench_q02/duckdb:vortex-file-compressed 19532866 19865231 0.98
clickbench_q03/duckdb:vortex-file-compressed 30392661 29469672 1.03
clickbench_q04/duckdb:vortex-file-compressed 127604056 135643197 0.94
clickbench_q05/duckdb:vortex-file-compressed 160777402 158882277 1.01
clickbench_q06/duckdb:vortex-file-compressed 19369137 18172235 1.07
clickbench_q07/duckdb:vortex-file-compressed 22635220 22177392 1.02
clickbench_q08/duckdb:vortex-file-compressed 165071240 166666309 0.99
clickbench_q09/duckdb:vortex-file-compressed 198332157 199724322 0.99
clickbench_q10/duckdb:vortex-file-compressed 67026902 64899768 1.03
clickbench_q11/duckdb:vortex-file-compressed 67605522 66132676 1.02
clickbench_q12/duckdb:vortex-file-compressed 194932586 193667089 1.01
clickbench_q13/duckdb:vortex-file-compressed 341875514 333266378 1.03
clickbench_q14/duckdb:vortex-file-compressed 202552583 214741725 0.94
clickbench_q15/duckdb:vortex-file-compressed 187031754 182463682 1.03
clickbench_q16/duckdb:vortex-file-compressed 391125782 396587452 0.99
clickbench_q17/duckdb:vortex-file-compressed 375842206 379046582 0.99
clickbench_q18/duckdb:vortex-file-compressed 737560668 747320043 0.99
clickbench_q19/duckdb:vortex-file-compressed 27921413 28771608 0.97
clickbench_q20/duckdb:vortex-file-compressed 240004270 239780521 1.00
clickbench_q21/duckdb:vortex-file-compressed 326024399 354239771 0.92
clickbench_q22/duckdb:vortex-file-compressed 478323952 512943456 0.93
clickbench_q23/duckdb:vortex-file-compressed 🚨 223911308 197036614 1.14
clickbench_q24/duckdb:vortex-file-compressed 56135971 55619819 1.01
clickbench_q25/duckdb:vortex-file-compressed 78406117 82817277 0.95
clickbench_q26/duckdb:vortex-file-compressed 🚨 69216263 61913685 1.12
clickbench_q27/duckdb:vortex-file-compressed 188359829 204876529 0.92
clickbench_q28/duckdb:vortex-file-compressed 🚨 1709514583 1250343748 1.37
clickbench_q29/duckdb:vortex-file-compressed 27655462 26526971 1.04
clickbench_q30/duckdb:vortex-file-compressed 166896450 165255845 1.01
clickbench_q31/duckdb:vortex-file-compressed 302539596 285330894 1.06
clickbench_q32/duckdb:vortex-file-compressed 918591851 944217973 0.97
clickbench_q33/duckdb:vortex-file-compressed 1097068026 1087059263 1.01
clickbench_q34/duckdb:vortex-file-compressed 1172378084 1151804077 1.02
clickbench_q35/duckdb:vortex-file-compressed 208165148 207945206 1.00
clickbench_q36/duckdb:vortex-file-compressed 🚨 41618354 34233678 1.22
clickbench_q37/duckdb:vortex-file-compressed 🚨 29272737 26330429 1.11
clickbench_q38/duckdb:vortex-file-compressed 🚨 35024778 29631434 1.18
clickbench_q39/duckdb:vortex-file-compressed 53541701 51015012 1.05
clickbench_q40/duckdb:vortex-file-compressed 🚨 30592981 26394759 1.16
clickbench_q41/duckdb:vortex-file-compressed 28751998 27092928 1.06
clickbench_q42/duckdb:vortex-file-compressed 26323495 28417956 0.93
duckdb / parquet / ns (0.997x ➖, 0↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 16789249 16986991 0.99
clickbench_q01/duckdb:parquet 16908228 15999994 1.06
clickbench_q02/duckdb:parquet 24523031 23422395 1.05
clickbench_q03/duckdb:parquet 26627948 26639990 1.00
clickbench_q04/duckdb:parquet 131026959 130254098 1.01
clickbench_q05/duckdb:parquet 185121055 185235475 1.00
clickbench_q06/duckdb:parquet 24003021 25760289 0.93
clickbench_q07/duckdb:parquet 20245036 19456443 1.04
clickbench_q08/duckdb:parquet 164268162 163300704 1.01
clickbench_q09/duckdb:parquet 231479169 231363318 1.00
clickbench_q10/duckdb:parquet 58057515 58323964 1.00
clickbench_q11/duckdb:parquet 66571499 67087405 0.99
clickbench_q12/duckdb:parquet 173727484 172842047 1.01
clickbench_q13/duckdb:parquet 306920899 308178235 1.00
clickbench_q14/duckdb:parquet 186041101 185322183 1.00
clickbench_q15/duckdb:parquet 184585475 182950525 1.01
clickbench_q16/duckdb:parquet 357023923 353575804 1.01
clickbench_q17/duckdb:parquet 364697058 357530795 1.02
clickbench_q18/duckdb:parquet 688959095 685697804 1.00
clickbench_q19/duckdb:parquet 20770931 22067062 0.94
clickbench_q20/duckdb:parquet 264851079 261739619 1.01
clickbench_q21/duckdb:parquet 319005316 311836587 1.02
clickbench_q22/duckdb:parquet 462221352 460915883 1.00
clickbench_q23/duckdb:parquet 🚨 263805576 239319582 1.10
clickbench_q24/duckdb:parquet 71504013 67620217 1.06
clickbench_q25/duckdb:parquet 72575913 72833604 1.00
clickbench_q26/duckdb:parquet 47370438 51482337 0.92
clickbench_q27/duckdb:parquet 269139415 277900990 0.97
clickbench_q28/duckdb:parquet 1709417525 1787773960 0.96
clickbench_q29/duckdb:parquet 26021133 28374279 0.92
clickbench_q30/duckdb:parquet 175651491 175215221 1.00
clickbench_q31/duckdb:parquet 306535606 309071511 0.99
clickbench_q32/duckdb:parquet 900891684 900399743 1.00
clickbench_q33/duckdb:parquet 786236292 777260020 1.01
clickbench_q34/duckdb:parquet 791846256 789357563 1.00
clickbench_q35/duckdb:parquet 207962064 209562352 0.99
clickbench_q36/duckdb:parquet 52420499 50880448 1.03
clickbench_q37/duckdb:parquet 37538152 36327892 1.03
clickbench_q38/duckdb:parquet 37606608 38696321 0.97
clickbench_q39/duckdb:parquet 85900183 89147375 0.96
clickbench_q40/duckdb:parquet 20427478 20882828 0.98
clickbench_q41/duckdb:parquet 19691359 20757555 0.95
clickbench_q42/duckdb:parquet 23255168 23708007 0.98
File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.88 MB 0 B 58.88 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.67 MB 0 B 90.67 MB -100.0%
hits_10.vortex 1.0 vortex-compact 49.48 MB 0 B 49.48 MB -100.0%
hits_11.vortex 1.0 vortex-compact 56.11 MB 0 B 56.11 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_13.vortex 1.0 vortex-compact 69.24 MB 0 B 69.24 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.88 MB 0 B 74.88 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.41 MB 0 B 48.41 MB -100.0%
hits_16.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.79 MB 0 B 58.79 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.89 MB 0 B 64.89 MB -100.0%
hits_19.vortex 1.0 vortex-compact 49.73 MB 0 B 49.73 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.16 MB 0 B 129.16 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.36 MB 0 B 38.36 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.99 MB 0 B 51.99 MB -100.0%
hits_22.vortex 1.0 vortex-compact 46.22 MB 0 B 46.22 MB -100.0%
hits_23.vortex 1.0 vortex-compact 46.13 MB 0 B 46.13 MB -100.0%
hits_24.vortex 1.0 vortex-compact 45.11 MB 0 B 45.11 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.88 MB 0 B 73.88 MB -100.0%
hits_26.vortex 1.0 vortex-compact 71.99 MB 0 B 71.99 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.92 MB 0 B 70.92 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.68 MB 0 B 36.68 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.12 MB 0 B 95.12 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.58 MB 0 B 58.58 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.77 MB 0 B 55.77 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.61 MB 0 B 44.61 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.92 MB 0 B 35.92 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.24 MB 0 B 58.24 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.53 MB 0 B 75.53 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.21 MB 0 B 49.21 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.76 MB 0 B 54.76 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_39.vortex 1.0 vortex-compact 50.10 MB 0 B 50.10 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.94 MB 0 B 71.94 MB -100.0%
hits_40.vortex 1.0 vortex-compact 77.42 MB 0 B 77.42 MB -100.0%
hits_41.vortex 1.0 vortex-compact 166.05 MB 0 B 166.05 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.53 MB 0 B 164.53 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.21 MB 0 B 169.21 MB -100.0%
hits_44.vortex 1.0 vortex-compact 133.26 MB 0 B 133.26 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.80 MB 0 B 75.80 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.27 MB 0 B 42.27 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.22 MB 0 B 18.22 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.85 MB 0 B 17.85 MB -100.0%
hits_49.vortex 1.0 vortex-compact 51.00 MB 0 B 51.00 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.33 MB 0 B 63.33 MB -100.0%
hits_50.vortex 1.0 vortex-compact 114.20 MB 0 B 114.20 MB -100.0%
hits_51.vortex 1.0 vortex-compact 168.34 MB 0 B 168.34 MB -100.0%
hits_52.vortex 1.0 vortex-compact 65.08 MB 0 B 65.08 MB -100.0%
hits_53.vortex 1.0 vortex-compact 60.05 MB 0 B 60.05 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.57 MB 0 B 117.57 MB -100.0%
hits_55.vortex 1.0 vortex-compact 92.56 MB 0 B 92.56 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.58 MB 0 B 78.58 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.73 MB 0 B 83.73 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.68 MB 0 B 66.68 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.57 MB 0 B 63.57 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.92 MB 0 B 64.92 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.73 MB 0 B 57.73 MB -100.0%
hits_62.vortex 1.0 vortex-compact 75.45 MB 0 B 75.45 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.44 MB 0 B 46.44 MB -100.0%
hits_64.vortex 1.0 vortex-compact 54.09 MB 0 B 54.09 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.40 MB 0 B 129.40 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.52 MB 0 B 53.52 MB -100.0%
hits_67.vortex 1.0 vortex-compact 114.44 MB 0 B 114.44 MB -100.0%
hits_68.vortex 1.0 vortex-compact 76.67 MB 0 B 76.67 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.98 MB 0 B 80.98 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.19 MB 0 B 64.19 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.84 MB 0 B 61.84 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.96 MB 0 B 69.96 MB -100.0%
hits_72.vortex 1.0 vortex-compact 52.74 MB 0 B 52.74 MB -100.0%
hits_73.vortex 1.0 vortex-compact 71.07 MB 0 B 71.07 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.87 MB 0 B 71.87 MB -100.0%
hits_75.vortex 1.0 vortex-compact 45.12 MB 0 B 45.12 MB -100.0%
hits_76.vortex 1.0 vortex-compact 77.10 MB 0 B 77.10 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.50 MB 0 B 118.50 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.85 MB 0 B 97.85 MB -100.0%
hits_79.vortex 1.0 vortex-compact 86.17 MB 0 B 86.17 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.67 MB 0 B 68.67 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.95 MB 0 B 65.95 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.43 MB 0 B 67.43 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.62 MB 0 B 53.62 MB -100.0%
hits_84.vortex 1.0 vortex-compact 74.35 MB 0 B 74.35 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.86 MB 0 B 52.86 MB -100.0%
hits_86.vortex 1.0 vortex-compact 49.12 MB 0 B 49.12 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.86 MB 0 B 118.86 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.59 MB 0 B 73.59 MB -100.0%
hits_89.vortex 1.0 vortex-compact 114.10 MB 0 B 114.10 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.32 MB 0 B 66.32 MB -100.0%
hits_90.vortex 1.0 vortex-compact 82.09 MB 0 B 82.09 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.40 MB 0 B 94.40 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.92 MB 0 B 59.92 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.90 MB 0 B 90.90 MB -100.0%
hits_95.vortex 1.0 vortex-compact 58.20 MB 0 B 58.20 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.74 MB 0 B 91.74 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.58 MB 0 B 69.58 MB -100.0%
hits_98.vortex 1.0 vortex-compact 73.15 MB 0 B 73.15 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.65 MB 0 B 77.65 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 0 B (-100.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.6%
Engines: DuckDB No clear signal (+4.6%, low confidence)
Vortex (geomean): 1.040x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-compact / ns (1.040x ➖, 1↑ 3↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 🚨 17342325 13599079 1.28
statpopgen_q01/duckdb:vortex-compact 15981796 16104980 0.99
statpopgen_q02/duckdb:vortex-compact 🚀 673040898 855813880 0.79
statpopgen_q03/duckdb:vortex-compact 1388270440 1335083902 1.04
statpopgen_q04/duckdb:vortex-compact 1389808812 1388186813 1.00
statpopgen_q05/duckdb:vortex-compact 650129217 663779746 0.98
statpopgen_q06/duckdb:vortex-compact 1719236783 1768708070 0.97
statpopgen_q07/duckdb:vortex-compact 1054363995 1039633465 1.01
statpopgen_q08/duckdb:vortex-compact 1065093593 1054048223 1.01
statpopgen_q09/duckdb:vortex-compact 🚨 1437715390 1081369337 1.33
statpopgen_q10/duckdb:vortex-compact 🚨 3355535725 2921796852 1.15
duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 375333255 376706920 1.00
statpopgen_q01/duckdb:parquet 466822610 466673811 1.00
statpopgen_q02/duckdb:parquet 769838256 777062783 0.99
statpopgen_q03/duckdb:parquet 1045148394 1048015644 1.00
statpopgen_q04/duckdb:parquet 1042167826 1047336126 1.00
statpopgen_q05/duckdb:parquet 758503214 765486453 0.99
statpopgen_q06/duckdb:parquet 1016341881 1019247918 1.00
statpopgen_q07/duckdb:parquet 959556585 962625831 1.00
statpopgen_q08/duckdb:parquet 962541828 970945718 0.99
statpopgen_q09/duckdb:parquet 995284529 1000607468 0.99
statpopgen_q10/duckdb:parquet 1627147825 1645344041 0.99
File Size Changes (2 files changed, -67.7% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 100000 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 0 B 1.96 GB -100.0%

Totals:

  • vortex-compact: 960.92 MB → 960.92 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.0%
Engines: DataFusion No clear signal (+4.1%, environment too noisy confidence) · DuckDB No clear signal (+10.0%, environment too noisy confidence)
Vortex (geomean): 0.968x ➖
Parquet (geomean): 0.905x ➖
Shifts: Parquet (control) -9.5% · Median polish -6.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-compact / ns (0.930x ➖, 1↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 577191269 579833101 1.00
tpch_q02/datafusion:vortex-compact 653330677 637944113 1.02
tpch_q03/datafusion:vortex-compact 529534769 499462952 1.06
tpch_q04/datafusion:vortex-compact 229076011 261872048 0.87
tpch_q05/datafusion:vortex-compact 685209228 717252049 0.96
tpch_q06/datafusion:vortex-compact 382113235 352528120 1.08
tpch_q07/datafusion:vortex-compact 735386780 708284603 1.04
tpch_q08/datafusion:vortex-compact 839409738 1027485600 0.82
tpch_q09/datafusion:vortex-compact 1106285045 1018552932 1.09
tpch_q10/datafusion:vortex-compact 989700690 910671097 1.09
tpch_q11/datafusion:vortex-compact 432551103 573161414 0.75
tpch_q12/datafusion:vortex-compact 595220939 600224530 0.99
tpch_q13/datafusion:vortex-compact 360798201 311069353 1.16
tpch_q14/datafusion:vortex-compact 406945715 474442587 0.86
tpch_q15/datafusion:vortex-compact 746750642 890504977 0.84
tpch_q16/datafusion:vortex-compact 319298310 318142538 1.00
tpch_q17/datafusion:vortex-compact 779050106 864246260 0.90
tpch_q18/datafusion:vortex-compact 864568476 880548146 0.98
tpch_q19/datafusion:vortex-compact 584850881 747404672 0.78
tpch_q20/datafusion:vortex-compact 625633184 814294908 0.77
tpch_q21/datafusion:vortex-compact 939685304 904177787 1.04
tpch_q22/datafusion:vortex-compact 🚀 298596483 499146654 0.60
datafusion / parquet / ns (0.894x ➖, 3↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 447382415 416864373 1.07
tpch_q02/datafusion:parquet 🚨 957505004 608652867 1.57
tpch_q03/datafusion:parquet 🚀 652502852 1602582284 0.41
tpch_q04/datafusion:parquet 🚀 384136797 548954118 0.70
tpch_q05/datafusion:parquet 792930596 952191377 0.83
tpch_q06/datafusion:parquet 🚀 232664938 453357333 0.51
tpch_q07/datafusion:parquet 891248867 1005184773 0.89
tpch_q08/datafusion:parquet 977419231 1126756878 0.87
tpch_q09/datafusion:parquet 1628575145 1486941009 1.10
tpch_q10/datafusion:parquet 1734808815 1794620177 0.97
tpch_q11/datafusion:parquet 475408764 488954803 0.97
tpch_q12/datafusion:parquet 437305829 459311722 0.95
tpch_q13/datafusion:parquet 599838203 611853277 0.98
tpch_q14/datafusion:parquet 430543705 406417266 1.06
tpch_q15/datafusion:parquet 703792148 724606431 0.97
tpch_q16/datafusion:parquet 315638979 421831993 0.75
tpch_q17/datafusion:parquet 850879026 880245602 0.97
tpch_q18/datafusion:parquet 1219886083 1246495094 0.98
tpch_q19/datafusion:parquet 483588671 560769056 0.86
tpch_q20/datafusion:parquet 832244456 925975687 0.90
tpch_q21/datafusion:parquet 1219196735 1094471722 1.11
tpch_q22/datafusion:parquet 746309058 844858042 0.88
duckdb / vortex-compact / ns (1.008x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 652166191 593281043 1.10
tpch_q02/duckdb:vortex-compact 850810290 783836266 1.09
tpch_q03/duckdb:vortex-compact 792101485 812505804 0.97
tpch_q04/duckdb:vortex-compact 589340891 566921378 1.04
tpch_q05/duckdb:vortex-compact 969925590 919797508 1.05
tpch_q06/duckdb:vortex-compact 710442711 645580277 1.10
tpch_q07/duckdb:vortex-compact 1078784575 1075716556 1.00
tpch_q08/duckdb:vortex-compact 1317958676 1334554963 0.99
tpch_q09/duckdb:vortex-compact 1331591345 1334589751 1.00
tpch_q10/duckdb:vortex-compact 1110437566 1198312921 0.93
tpch_q11/duckdb:vortex-compact 458159230 482100899 0.95
tpch_q12/duckdb:vortex-compact 1209323660 1173325398 1.03
tpch_q13/duckdb:vortex-compact 748227715 692519584 1.08
tpch_q14/duckdb:vortex-compact 640970704 622335805 1.03
tpch_q15/duckdb:vortex-compact 595645510 575887118 1.03
tpch_q16/duckdb:vortex-compact 306143448 316891864 0.97
tpch_q17/duckdb:vortex-compact 956917383 977894631 0.98
tpch_q18/duckdb:vortex-compact 707279482 854043037 0.83
tpch_q19/duckdb:vortex-compact 813411402 827901301 0.98
tpch_q20/duckdb:vortex-compact 1094533439 1052323549 1.04
tpch_q21/duckdb:vortex-compact 1849828429 1745835383 1.06
tpch_q22/duckdb:vortex-compact 297241885 304291700 0.98
duckdb / parquet / ns (0.917x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 403409295 535390523 0.75
tpch_q02/duckdb:parquet 859243163 1042840368 0.82
tpch_q03/duckdb:parquet 1176624461 1424207087 0.83
tpch_q04/duckdb:parquet 718325235 780295902 0.92
tpch_q05/duckdb:parquet 1304189789 1422936341 0.92
tpch_q06/duckdb:parquet 380887169 482634637 0.79
tpch_q07/duckdb:parquet 1104857274 1127448623 0.98
tpch_q08/duckdb:parquet 1434038868 1558274568 0.92
tpch_q09/duckdb:parquet 1449849533 1451778577 1.00
tpch_q10/duckdb:parquet 2631557716 2586484966 1.02
tpch_q11/duckdb:parquet 519431678 519687248 1.00
tpch_q12/duckdb:parquet 804891900 956115219 0.84
tpch_q13/duckdb:parquet 1025399284 1124791185 0.91
tpch_q14/duckdb:parquet 771987974 781824820 0.99
tpch_q15/duckdb:parquet 469403540 616146497 0.76
tpch_q16/duckdb:parquet 685195472 720984981 0.95
tpch_q17/duckdb:parquet 680184785 700989381 0.97
tpch_q18/duckdb:parquet 914286883 936842937 0.98
tpch_q19/duckdb:parquet 959713625 875700186 1.10
tpch_q20/duckdb:parquet 1227749374 1362622441 0.90
tpch_q21/duckdb:parquet 1112947638 1106561166 1.01
tpch_q22/duckdb:parquet 903931789 984266427 0.92

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (-2.3%, environment too noisy confidence) · DuckDB No clear signal (+3.5%, low confidence)
Vortex (geomean): 1.013x ➖
Parquet (geomean): 1.008x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed / ns (1.002x ➖, 1↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 452658792 453640917 1.00
clickbench-sorted_q24/datafusion:vortex-file-compressed 22798922 21617782 1.05
clickbench-sorted_q26/datafusion:vortex-file-compressed 22300087 22026421 1.01
clickbench-sorted_q36/datafusion:vortex-file-compressed 🚨 55803004 47166446 1.18
clickbench-sorted_q37/datafusion:vortex-file-compressed 37957647 35544002 1.07
clickbench-sorted_q38/datafusion:vortex-file-compressed 🚀 34096022 41913454 0.81
clickbench-sorted_q39/datafusion:vortex-file-compressed 88714517 92646033 0.96
clickbench-sorted_q40/datafusion:vortex-file-compressed 17081547 16934808 1.01
clickbench-sorted_q41/datafusion:vortex-file-compressed 16950777 17307713 0.98
clickbench-sorted_q42/datafusion:vortex-file-compressed 13068511 13318554 0.98
datafusion / parquet / ns (1.025x ➖, 0↑ 2↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 2930875621 2933109295 1.00
clickbench-sorted_q24/datafusion:parquet 🚨 39801778 31152569 1.28
clickbench-sorted_q26/datafusion:parquet 31728479 33488939 0.95
clickbench-sorted_q36/datafusion:parquet 187479964 183515356 1.02
clickbench-sorted_q37/datafusion:parquet 101653710 105523130 0.96
clickbench-sorted_q38/datafusion:parquet 159704587 164069727 0.97
clickbench-sorted_q39/datafusion:parquet 315144737 297439697 1.06
clickbench-sorted_q40/datafusion:parquet 63737421 70404361 0.91
clickbench-sorted_q41/datafusion:parquet 🚨 66542880 58332283 1.14
clickbench-sorted_q42/datafusion:parquet 33533650 33140774 1.01
duckdb / vortex-file-compressed / ns (1.025x ➖, 0↑ 1↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 225445147 225769614 1.00
clickbench-sorted_q24/duckdb:vortex-file-compressed 39339905 38697320 1.02
clickbench-sorted_q26/duckdb:vortex-file-compressed 64852946 66436409 0.98
clickbench-sorted_q36/duckdb:vortex-file-compressed 69758858 66244196 1.05
clickbench-sorted_q37/duckdb:vortex-file-compressed 58543804 54524646 1.07
clickbench-sorted_q38/duckdb:vortex-file-compressed 63115434 63379921 1.00
clickbench-sorted_q39/duckdb:vortex-file-compressed 116086632 118421367 0.98
clickbench-sorted_q40/duckdb:vortex-file-compressed 38582931 36138016 1.07
clickbench-sorted_q41/duckdb:vortex-file-compressed 38549807 39510941 0.98
clickbench-sorted_q42/duckdb:vortex-file-compressed 🚨 34212966 30510964 1.12
duckdb / parquet / ns (0.990x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 216884608 229040498 0.95
clickbench-sorted_q24/duckdb:parquet 31478460 31884946 0.99
clickbench-sorted_q26/duckdb:parquet 23562137 22283513 1.06
clickbench-sorted_q36/duckdb:parquet 68244605 70209544 0.97
clickbench-sorted_q37/duckdb:parquet 58996947 57677340 1.02
clickbench-sorted_q38/duckdb:parquet 60291456 64018581 0.94
clickbench-sorted_q39/duckdb:parquet 105113640 108794369 0.97
clickbench-sorted_q40/duckdb:parquet 28933013 28809224 1.00
clickbench-sorted_q41/duckdb:parquet 28030594 28267314 0.99
clickbench-sorted_q42/duckdb:parquet 19784849 19414031 1.02
File Size Changes (201 files changed, -42.8% overall, 50↑ 151↓)
File Scale Format Base HEAD Change %
hits_053.vortex 1.0 vortex-file-compressed 190.00 MB 191.94 MB +1.95 MB +1.0%
hits_088.vortex 1.0 vortex-file-compressed 172.04 MB 173.59 MB +1.55 MB +0.9%
hits_022.vortex 1.0 vortex-file-compressed 197.70 MB 199.44 MB +1.74 MB +0.9%
hits_007.vortex 1.0 vortex-file-compressed 198.63 MB 200.15 MB +1.51 MB +0.8%
hits_034.vortex 1.0 vortex-file-compressed 182.38 MB 183.45 MB +1.07 MB +0.6%
hits_011.vortex 1.0 vortex-file-compressed 198.50 MB 199.61 MB +1.11 MB +0.6%
hits_055.vortex 1.0 vortex-file-compressed 198.58 MB 199.60 MB +1.02 MB +0.5%
hits_071.vortex 1.0 vortex-file-compressed 140.00 MB 140.64 MB +653.48 KB +0.5%
hits_018.vortex 1.0 vortex-file-compressed 198.77 MB 199.55 MB +796.12 KB +0.4%
hits_014.vortex 1.0 vortex-file-compressed 172.09 MB 172.76 MB +685.27 KB +0.4%
hits_070.vortex 1.0 vortex-file-compressed 199.79 MB 200.45 MB +677.35 KB +0.3%
hits_062.vortex 1.0 vortex-file-compressed 170.20 MB 170.75 MB +562.23 KB +0.3%
hits_054.vortex 1.0 vortex-file-compressed 147.10 MB 147.52 MB +431.77 KB +0.3%
hits_060.vortex 1.0 vortex-file-compressed 194.52 MB 195.07 MB +559.76 KB +0.3%
hits_064.vortex 1.0 vortex-file-compressed 190.85 MB 191.36 MB +523.81 KB +0.3%
hits_041.vortex 1.0 vortex-file-compressed 131.24 MB 131.57 MB +344.48 KB +0.3%
hits_050.vortex 1.0 vortex-file-compressed 161.19 MB 161.58 MB +393.32 KB +0.2%
hits_057.vortex 1.0 vortex-file-compressed 160.43 MB 160.79 MB +365.40 KB +0.2%
hits_046.vortex 1.0 vortex-file-compressed 101.19 MB 101.40 MB +215.82 KB +0.2%
hits_068.vortex 1.0 vortex-file-compressed 160.87 MB 161.17 MB +311.55 KB +0.2%
hits_004.vortex 1.0 vortex-file-compressed 131.62 MB 131.87 MB +254.66 KB +0.2%
hits_083.vortex 1.0 vortex-file-compressed 157.02 MB 157.31 MB +290.83 KB +0.2%
hits_020.vortex 1.0 vortex-file-compressed 160.34 MB 160.62 MB +286.63 KB +0.2%
hits_044.vortex 1.0 vortex-file-compressed 199.92 MB 200.26 MB +351.18 KB +0.2%
hits_028.vortex 1.0 vortex-file-compressed 152.32 MB 152.53 MB +220.04 KB +0.1%
hits_036.vortex 1.0 vortex-file-compressed 171.27 MB 171.48 MB +216.99 KB +0.1%
hits_021.vortex 1.0 vortex-file-compressed 154.32 MB 154.50 MB +191.04 KB +0.1%
hits_081.vortex 1.0 vortex-file-compressed 199.87 MB 200.10 MB +243.29 KB +0.1%
hits_069.vortex 1.0 vortex-file-compressed 142.17 MB 142.33 MB +170.43 KB +0.1%
hits_079.vortex 1.0 vortex-file-compressed 180.84 MB 181.03 MB +195.16 KB +0.1%
hits_009.vortex 1.0 vortex-file-compressed 101.28 MB 101.38 MB +102.28 KB +0.1%
hits_023.vortex 1.0 vortex-file-compressed 195.23 MB 195.42 MB +192.34 KB +0.1%
hits_033.vortex 1.0 vortex-file-compressed 199.89 MB 200.08 MB +192.84 KB +0.1%
hits_031.vortex 1.0 vortex-file-compressed 160.07 MB 160.20 MB +125.58 KB +0.1%
hits_043.vortex 1.0 vortex-file-compressed 126.46 MB 126.55 MB +86.55 KB +0.1%
hits_047.vortex 1.0 vortex-file-compressed 154.45 MB 154.55 MB +101.88 KB +0.1%
hits_096.vortex 1.0 vortex-file-compressed 199.40 MB 199.52 MB +126.97 KB +0.1%
hits_017.vortex 1.0 vortex-file-compressed 146.81 MB 146.90 MB +92.98 KB +0.1%
hits_092.vortex 1.0 vortex-file-compressed 199.51 MB 199.63 MB +117.88 KB +0.1%
hits_003.vortex 1.0 vortex-file-compressed 136.45 MB 136.52 MB +73.33 KB +0.1%
hits_058.vortex 1.0 vortex-file-compressed 155.07 MB 155.14 MB +73.87 KB +0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.93 MB 193.01 MB +89.17 KB +0.0%
hits_072.vortex 1.0 vortex-file-compressed 102.28 MB 102.32 MB +44.49 KB +0.0%
hits_066.vortex 1.0 vortex-file-compressed 163.00 MB 163.07 MB +67.67 KB +0.0%
hits_029.vortex 1.0 vortex-file-compressed 199.79 MB 199.84 MB +60.12 KB +0.0%
hits_076.vortex 1.0 vortex-file-compressed 161.00 MB 161.02 MB +25.26 KB +0.0%
hits_073.vortex 1.0 vortex-file-compressed 172.69 MB 172.71 MB +18.02 KB +0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.29 MB 172.31 MB +17.90 KB +0.0%
hits_063.vortex 1.0 vortex-file-compressed 132.07 MB 132.08 MB +4.50 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.93 MB 126.94 MB +2.34 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.40 MB 126.40 MB 4.47 KB -0.0%
hits_005.vortex 1.0 vortex-file-compressed 167.62 MB 167.61 MB 9.00 KB -0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.62 MB 189.60 MB 16.32 KB -0.0%
hits_032.vortex 1.0 vortex-file-compressed 154.75 MB 154.74 MB 13.70 KB -0.0%
hits_016.vortex 1.0 vortex-file-compressed 180.20 MB 180.18 MB 18.49 KB -0.0%
hits_067.vortex 1.0 vortex-file-compressed 131.71 MB 131.68 MB 23.37 KB -0.0%
hits_038.vortex 1.0 vortex-file-compressed 190.12 MB 190.08 MB 34.64 KB -0.0%
hits_045.vortex 1.0 vortex-file-compressed 140.11 MB 140.09 MB 26.72 KB -0.0%
hits_048.vortex 1.0 vortex-file-compressed 198.44 MB 198.38 MB 57.10 KB -0.0%
hits_089.vortex 1.0 vortex-file-compressed 131.59 MB 131.53 MB 52.41 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.10 MB 161.04 MB 67.65 KB -0.0%
hits_074.vortex 1.0 vortex-file-compressed 198.19 MB 198.09 MB 97.48 KB -0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.04 MB 146.96 MB 84.52 KB -0.1%
hits_030.vortex 1.0 vortex-file-compressed 131.89 MB 131.81 MB 84.51 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.70 MB 137.60 MB 103.38 KB -0.1%
hits_052.vortex 1.0 vortex-file-compressed 131.04 MB 130.94 MB 99.81 KB -0.1%
hits_095.vortex 1.0 vortex-file-compressed 154.49 MB 154.37 MB 122.49 KB -0.1%
hits_061.vortex 1.0 vortex-file-compressed 160.95 MB 160.82 MB 138.26 KB -0.1%
hits_078.vortex 1.0 vortex-file-compressed 131.16 MB 131.05 MB 117.91 KB -0.1%
hits_049.vortex 1.0 vortex-file-compressed 191.70 MB 191.52 MB 184.30 KB -0.1%
hits_000.vortex 1.0 vortex-file-compressed 131.74 MB 131.61 MB 138.03 KB -0.1%
hits_093.vortex 1.0 vortex-file-compressed 131.73 MB 131.59 MB 144.69 KB -0.1%
hits_019.vortex 1.0 vortex-file-compressed 141.07 MB 140.90 MB 174.35 KB -0.1%
hits_077.vortex 1.0 vortex-file-compressed 172.80 MB 172.59 MB 222.62 KB -0.1%
hits_059.vortex 1.0 vortex-file-compressed 199.21 MB 198.96 MB 257.16 KB -0.1%
hits_002.vortex 1.0 vortex-file-compressed 161.06 MB 160.84 MB 228.28 KB -0.1%
hits_015.vortex 1.0 vortex-file-compressed 131.23 MB 131.05 MB 187.59 KB -0.1%
hits_085.vortex 1.0 vortex-file-compressed 199.98 MB 199.69 MB 292.95 KB -0.1%
hits_010.vortex 1.0 vortex-file-compressed 169.30 MB 169.06 MB 253.64 KB -0.1%
hits_035.vortex 1.0 vortex-file-compressed 103.18 MB 103.03 MB 160.70 KB -0.2%
hits_090.vortex 1.0 vortex-file-compressed 192.83 MB 192.53 MB 302.05 KB -0.2%
hits_086.vortex 1.0 vortex-file-compressed 192.41 MB 192.11 MB 307.12 KB -0.2%
hits_037.vortex 1.0 vortex-file-compressed 177.44 MB 177.10 MB 352.14 KB -0.2%
hits_099.vortex 1.0 vortex-file-compressed 171.56 MB 171.20 MB 373.61 KB -0.2%
hits_051.vortex 1.0 vortex-file-compressed 172.83 MB 172.45 MB 390.32 KB -0.2%
hits_042.vortex 1.0 vortex-file-compressed 202.11 MB 201.60 MB 520.94 KB -0.3%
hits_012.vortex 1.0 vortex-file-compressed 191.46 MB 190.88 MB 594.20 KB -0.3%
hits_084.vortex 1.0 vortex-file-compressed 155.16 MB 154.66 MB 512.73 KB -0.3%
hits_065.vortex 1.0 vortex-file-compressed 161.84 MB 161.29 MB 560.17 KB -0.3%
hits_026.vortex 1.0 vortex-file-compressed 131.40 MB 130.95 MB 464.52 KB -0.3%
hits_056.vortex 1.0 vortex-file-compressed 136.23 MB 135.73 MB 506.38 KB -0.4%
hits_008.vortex 1.0 vortex-file-compressed 140.51 MB 139.98 MB 548.29 KB -0.4%
hits_094.vortex 1.0 vortex-file-compressed 158.38 MB 157.73 MB 662.91 KB -0.4%
hits_013.vortex 1.0 vortex-file-compressed 161.85 MB 161.15 MB 712.48 KB -0.4%
hits_040.vortex 1.0 vortex-file-compressed 143.85 MB 143.20 MB 662.43 KB -0.4%
hits_082.vortex 1.0 vortex-file-compressed 140.73 MB 140.01 MB 739.13 KB -0.5%
hits_024.vortex 1.0 vortex-file-compressed 161.10 MB 159.59 MB 1.51 MB -0.9%
hits_087.vortex 1.0 vortex-file-compressed 161.02 MB 159.44 MB 1.58 MB -1.0%
hits_027.vortex 1.0 vortex-file-compressed 191.84 MB 189.92 MB 1.92 MB -1.0%
hits_001.vortex 1.0 vortex-file-compressed 191.32 MB 189.13 MB 2.18 MB -1.1%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-compact 98.54 MB 0 B 98.54 MB -100.0%
hits_001.vortex 1.0 vortex-compact 139.04 MB 0 B 139.04 MB -100.0%
hits_002.vortex 1.0 vortex-compact 124.24 MB 0 B 124.24 MB -100.0%
hits_003.vortex 1.0 vortex-compact 104.55 MB 0 B 104.55 MB -100.0%
hits_004.vortex 1.0 vortex-compact 97.69 MB 0 B 97.69 MB -100.0%
hits_005.vortex 1.0 vortex-compact 115.83 MB 0 B 115.83 MB -100.0%
hits_006.vortex 1.0 vortex-compact 95.95 MB 0 B 95.95 MB -100.0%
hits_007.vortex 1.0 vortex-compact 153.51 MB 0 B 153.51 MB -100.0%
hits_008.vortex 1.0 vortex-compact 106.14 MB 0 B 106.14 MB -100.0%
hits_009.vortex 1.0 vortex-compact 76.46 MB 0 B 76.46 MB -100.0%
hits_010.vortex 1.0 vortex-compact 123.56 MB 0 B 123.56 MB -100.0%
hits_011.vortex 1.0 vortex-compact 152.88 MB 0 B 152.88 MB -100.0%
hits_012.vortex 1.0 vortex-compact 140.33 MB 0 B 140.33 MB -100.0%
hits_013.vortex 1.0 vortex-compact 124.39 MB 0 B 124.39 MB -100.0%
hits_014.vortex 1.0 vortex-compact 133.90 MB 0 B 133.90 MB -100.0%
hits_015.vortex 1.0 vortex-compact 98.02 MB 0 B 98.02 MB -100.0%
hits_016.vortex 1.0 vortex-compact 127.30 MB 0 B 127.30 MB -100.0%
hits_017.vortex 1.0 vortex-compact 112.24 MB 0 B 112.24 MB -100.0%
hits_018.vortex 1.0 vortex-compact 153.74 MB 0 B 153.74 MB -100.0%
hits_019.vortex 1.0 vortex-compact 106.17 MB 0 B 106.17 MB -100.0%
hits_020.vortex 1.0 vortex-compact 111.75 MB 0 B 111.75 MB -100.0%
hits_021.vortex 1.0 vortex-compact 110.63 MB 0 B 110.63 MB -100.0%
hits_022.vortex 1.0 vortex-compact 153.28 MB 0 B 153.28 MB -100.0%
hits_023.vortex 1.0 vortex-compact 142.62 MB 0 B 142.62 MB -100.0%
hits_024.vortex 1.0 vortex-compact 125.32 MB 0 B 125.32 MB -100.0%
hits_025.vortex 1.0 vortex-compact 133.69 MB 0 B 133.69 MB -100.0%
hits_026.vortex 1.0 vortex-compact 98.70 MB 0 B 98.70 MB -100.0%
hits_027.vortex 1.0 vortex-compact 139.37 MB 0 B 139.37 MB -100.0%
hits_028.vortex 1.0 vortex-compact 115.33 MB 0 B 115.33 MB -100.0%
hits_029.vortex 1.0 vortex-compact 153.57 MB 0 B 153.57 MB -100.0%
hits_030.vortex 1.0 vortex-compact 98.44 MB 0 B 98.44 MB -100.0%
hits_031.vortex 1.0 vortex-compact 111.66 MB 0 B 111.66 MB -100.0%
hits_032.vortex 1.0 vortex-compact 110.65 MB 0 B 110.65 MB -100.0%
hits_033.vortex 1.0 vortex-compact 153.58 MB 0 B 153.58 MB -100.0%
hits_034.vortex 1.0 vortex-compact 133.35 MB 0 B 133.35 MB -100.0%
hits_035.vortex 1.0 vortex-compact 75.93 MB 0 B 75.93 MB -100.0%
hits_036.vortex 1.0 vortex-compact 133.62 MB 0 B 133.62 MB -100.0%
hits_037.vortex 1.0 vortex-compact 132.36 MB 0 B 132.36 MB -100.0%
hits_038.vortex 1.0 vortex-compact 138.26 MB 0 B 138.26 MB -100.0%
hits_039.vortex 1.0 vortex-compact 124.35 MB 0 B 124.35 MB -100.0%
hits_040.vortex 1.0 vortex-compact 110.12 MB 0 B 110.12 MB -100.0%
hits_041.vortex 1.0 vortex-compact 97.89 MB 0 B 97.89 MB -100.0%
hits_042.vortex 1.0 vortex-compact 136.27 MB 0 B 136.27 MB -100.0%
hits_043.vortex 1.0 vortex-compact 94.26 MB 0 B 94.26 MB -100.0%
hits_044.vortex 1.0 vortex-compact 153.60 MB 0 B 153.60 MB -100.0%
hits_045.vortex 1.0 vortex-compact 106.18 MB 0 B 106.18 MB -100.0%
hits_046.vortex 1.0 vortex-compact 74.90 MB 0 B 74.90 MB -100.0%
hits_047.vortex 1.0 vortex-compact 110.52 MB 0 B 110.52 MB -100.0%
hits_048.vortex 1.0 vortex-compact 153.13 MB 0 B 153.13 MB -100.0%
hits_049.vortex 1.0 vortex-compact 139.32 MB 0 B 139.32 MB -100.0%
hits_050.vortex 1.0 vortex-compact 123.76 MB 0 B 123.76 MB -100.0%
hits_051.vortex 1.0 vortex-compact 133.93 MB 0 B 133.93 MB -100.0%
hits_052.vortex 1.0 vortex-compact 98.46 MB 0 B 98.46 MB -100.0%
hits_053.vortex 1.0 vortex-compact 138.47 MB 0 B 138.47 MB -100.0%
hits_054.vortex 1.0 vortex-compact 112.11 MB 0 B 112.11 MB -100.0%
hits_055.vortex 1.0 vortex-compact 153.28 MB 0 B 153.28 MB -100.0%
hits_056.vortex 1.0 vortex-compact 100.84 MB 0 B 100.84 MB -100.0%
hits_057.vortex 1.0 vortex-compact 111.38 MB 0 B 111.38 MB -100.0%
hits_058.vortex 1.0 vortex-compact 111.09 MB 0 B 111.09 MB -100.0%
hits_059.vortex 1.0 vortex-compact 153.00 MB 0 B 153.00 MB -100.0%
hits_060.vortex 1.0 vortex-compact 141.29 MB 0 B 141.29 MB -100.0%
hits_061.vortex 1.0 vortex-compact 126.06 MB 0 B 126.06 MB -100.0%
hits_062.vortex 1.0 vortex-compact 132.59 MB 0 B 132.59 MB -100.0%
hits_063.vortex 1.0 vortex-compact 97.86 MB 0 B 97.86 MB -100.0%
hits_064.vortex 1.0 vortex-compact 140.15 MB 0 B 140.15 MB -100.0%
hits_065.vortex 1.0 vortex-compact 125.73 MB 0 B 125.73 MB -100.0%
hits_066.vortex 1.0 vortex-compact 117.38 MB 0 B 117.38 MB -100.0%
hits_067.vortex 1.0 vortex-compact 99.20 MB 0 B 99.20 MB -100.0%
hits_068.vortex 1.0 vortex-compact 112.53 MB 0 B 112.53 MB -100.0%
hits_069.vortex 1.0 vortex-compact 99.55 MB 0 B 99.55 MB -100.0%
hits_070.vortex 1.0 vortex-compact 153.59 MB 0 B 153.59 MB -100.0%
hits_071.vortex 1.0 vortex-compact 106.11 MB 0 B 106.11 MB -100.0%
hits_072.vortex 1.0 vortex-compact 75.66 MB 0 B 75.66 MB -100.0%
hits_073.vortex 1.0 vortex-compact 134.20 MB 0 B 134.20 MB -100.0%
hits_074.vortex 1.0 vortex-compact 152.93 MB 0 B 152.93 MB -100.0%
hits_075.vortex 1.0 vortex-compact 137.90 MB 0 B 137.90 MB -100.0%
hits_076.vortex 1.0 vortex-compact 126.07 MB 0 B 126.07 MB -100.0%
hits_077.vortex 1.0 vortex-compact 134.14 MB 0 B 134.14 MB -100.0%
hits_078.vortex 1.0 vortex-compact 97.62 MB 0 B 97.62 MB -100.0%
hits_079.vortex 1.0 vortex-compact 128.09 MB 0 B 128.09 MB -100.0%
hits_080.vortex 1.0 vortex-compact 94.62 MB 0 B 94.62 MB -100.0%
hits_081.vortex 1.0 vortex-compact 153.66 MB 0 B 153.66 MB -100.0%
hits_082.vortex 1.0 vortex-compact 106.25 MB 0 B 106.25 MB -100.0%
hits_083.vortex 1.0 vortex-compact 110.16 MB 0 B 110.16 MB -100.0%
hits_084.vortex 1.0 vortex-compact 111.18 MB 0 B 111.18 MB -100.0%
hits_085.vortex 1.0 vortex-compact 153.31 MB 0 B 153.31 MB -100.0%
hits_086.vortex 1.0 vortex-compact 140.96 MB 0 B 140.96 MB -100.0%
hits_087.vortex 1.0 vortex-compact 126.35 MB 0 B 126.35 MB -100.0%
hits_088.vortex 1.0 vortex-compact 134.13 MB 0 B 134.13 MB -100.0%
hits_089.vortex 1.0 vortex-compact 98.56 MB 0 B 98.56 MB -100.0%
hits_090.vortex 1.0 vortex-compact 141.22 MB 0 B 141.22 MB -100.0%
hits_091.vortex 1.0 vortex-compact 111.80 MB 0 B 111.80 MB -100.0%
hits_092.vortex 1.0 vortex-compact 153.41 MB 0 B 153.41 MB -100.0%
hits_093.vortex 1.0 vortex-compact 99.30 MB 0 B 99.30 MB -100.0%
hits_094.vortex 1.0 vortex-compact 110.76 MB 0 B 110.76 MB -100.0%
hits_095.vortex 1.0 vortex-compact 110.71 MB 0 B 110.71 MB -100.0%
hits_096.vortex 1.0 vortex-compact 153.20 MB 0 B 153.20 MB -100.0%
hits_097.vortex 1.0 vortex-compact 141.28 MB 0 B 141.28 MB -100.0%
hits_098.vortex 1.0 vortex-compact 104.01 MB 0 B 104.01 MB -100.0%
hits_099.vortex 1.0 vortex-compact 133.07 MB 0 B 133.07 MB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 15.96 GB → 15.97 GB (+0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.6%
Engines: DataFusion No clear signal (+1.8%, low confidence) · DuckDB No clear signal (+1.4%, environment too noisy confidence)
Vortex (geomean): 1.007x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-compact / ns (1.007x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 363249792 363607240 1.00
tpch_q02/datafusion:vortex-compact 104787755 103693348 1.01
tpch_q03/datafusion:vortex-compact 159138170 159102141 1.00
tpch_q04/datafusion:vortex-compact 85301830 84473414 1.01
tpch_q05/datafusion:vortex-compact 276668362 272325280 1.02
tpch_q06/datafusion:vortex-compact 39840078 38574715 1.03
tpch_q07/datafusion:vortex-compact 368572429 369512902 1.00
tpch_q08/datafusion:vortex-compact 296183070 290491746 1.02
tpch_q09/datafusion:vortex-compact 480452365 480215542 1.00
tpch_q10/datafusion:vortex-compact 196642611 195825622 1.00
tpch_q11/datafusion:vortex-compact 74138445 74495183 1.00
tpch_q12/datafusion:vortex-compact 123157918 125854883 0.98
tpch_q13/datafusion:vortex-compact 146322659 146421138 1.00
tpch_q14/datafusion:vortex-compact 53696573 52817212 1.02
tpch_q15/datafusion:vortex-compact 108978754 109100526 1.00
tpch_q16/datafusion:vortex-compact 80387292 76121038 1.06
tpch_q17/datafusion:vortex-compact 442809833 431564198 1.03
tpch_q18/datafusion:vortex-compact 655098097 653580062 1.00
tpch_q19/datafusion:vortex-compact 153762765 155724412 0.99
tpch_q20/datafusion:vortex-compact 152132056 151209915 1.01
tpch_q21/datafusion:vortex-compact 482751334 490844780 0.98
tpch_q22/datafusion:vortex-compact 47707831 46943455 1.02
datafusion / parquet / ns (0.989x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 324528259 320010544 1.01
tpch_q02/datafusion:parquet 218274559 216608177 1.01
tpch_q03/datafusion:parquet 232405473 232561984 1.00
tpch_q04/datafusion:parquet 99826899 99026015 1.01
tpch_q05/datafusion:parquet 355768158 360004021 0.99
tpch_q06/datafusion:parquet 75063383 75268029 1.00
tpch_q07/datafusion:parquet 522423804 522736494 1.00
tpch_q08/datafusion:parquet 405661200 411577696 0.99
tpch_q09/datafusion:parquet 674689492 665684021 1.01
tpch_q10/datafusion:parquet 557450984 557282599 1.00
tpch_q11/datafusion:parquet 152706542 160252754 0.95
tpch_q12/datafusion:parquet 149715923 156751848 0.96
tpch_q13/datafusion:parquet 354810081 349590801 1.01
tpch_q14/datafusion:parquet 119587597 119866179 1.00
tpch_q15/datafusion:parquet 188289464 195184954 0.96
tpch_q16/datafusion:parquet 136799359 142779785 0.96
tpch_q17/datafusion:parquet 499601559 508648914 0.98
tpch_q18/datafusion:parquet 684914127 695425167 0.98
tpch_q19/datafusion:parquet 195886561 205910981 0.95
tpch_q20/datafusion:parquet 297149273 307535207 0.97
tpch_q21/datafusion:parquet 544053347 540587959 1.01
tpch_q22/datafusion:parquet 261971464 259055433 1.01
duckdb / vortex-compact / ns (1.007x ➖, 0↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 113973631 111670537 1.02
tpch_q02/duckdb:vortex-compact 76304908 77175923 0.99
tpch_q03/duckdb:vortex-compact 134987581 126165216 1.07
tpch_q04/duckdb:vortex-compact 158977135 160439493 0.99
tpch_q05/duckdb:vortex-compact 153166284 152228458 1.01
tpch_q06/duckdb:vortex-compact 41446999 40799542 1.02
tpch_q07/duckdb:vortex-compact 143595430 140066827 1.03
tpch_q08/duckdb:vortex-compact 184477293 184062374 1.00
tpch_q09/duckdb:vortex-compact 314322263 323958221 0.97
tpch_q10/duckdb:vortex-compact 215868169 210491332 1.03
tpch_q11/duckdb:vortex-compact 43790042 40859862 1.07
tpch_q12/duckdb:vortex-compact 123732899 119589392 1.03
tpch_q13/duckdb:vortex-compact 174710781 178970377 0.98
tpch_q14/duckdb:vortex-compact 65576697 64252503 1.02
tpch_q15/duckdb:vortex-compact 92703965 93518075 0.99
tpch_q16/duckdb:vortex-compact 86588122 88528209 0.98
tpch_q17/duckdb:vortex-compact 110677534 107295752 1.03
tpch_q18/duckdb:vortex-compact 253357400 258124538 0.98
tpch_q19/duckdb:vortex-compact 89966952 88401134 1.02
tpch_q20/duckdb:vortex-compact 151176588 151904661 1.00
tpch_q21/duckdb:vortex-compact 477164855 475282084 1.00
tpch_q22/duckdb:vortex-compact 77498519 82830217 0.94
duckdb / parquet / ns (0.993x ➖, 1↑ 0↓)
name PR 34d36b1 (ns) base 68e0e58 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 103587852 127435698 0.81
tpch_q02/duckdb:parquet 99530051 100795813 0.99
tpch_q03/duckdb:parquet 168682394 166929861 1.01
tpch_q04/duckdb:parquet 118895718 122403660 0.97
tpch_q05/duckdb:parquet 185237407 186578193 0.99
tpch_q06/duckdb:parquet 56500714 59432753 0.95
tpch_q07/duckdb:parquet 138374625 143348161 0.97
tpch_q08/duckdb:parquet 222808351 218877989 1.02
tpch_q09/duckdb:parquet 347615221 348443266 1.00
tpch_q10/duckdb:parquet 656148355 660531928 0.99
tpch_q11/duckdb:parquet 45554480 41660068 1.09
tpch_q12/duckdb:parquet 118527541 117717568 1.01
tpch_q13/duckdb:parquet 397593601 401606516 0.99
tpch_q14/duckdb:parquet 153581282 150156319 1.02
tpch_q15/duckdb:parquet 80322744 78033995 1.03
tpch_q16/duckdb:parquet 154553340 154862112 1.00
tpch_q17/duckdb:parquet 128071785 116677571 1.10
tpch_q18/duckdb:parquet 295134855 296423758 1.00
tpch_q19/duckdb:parquet 228192272 242554102 0.94
tpch_q20/duckdb:parquet 196784499 197671071 1.00
tpch_q21/duckdb:parquet 444089715 442118121 1.00
tpch_q22/duckdb:parquet 336617944 336297779 1.00
File Size Changes (9 files changed, -56.0% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 10.0 vortex-file-compressed 87.23 MB 0 B 87.23 MB -100.0%
duckdb.db 10.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 10.0 vortex-file-compressed 1.65 GB 0 B 1.65 GB -100.0%
nation.vortex 10.0 vortex-file-compressed 11.07 KB 0 B 11.07 KB -100.0%
orders.vortex 10.0 vortex-file-compressed 436.71 MB 0 B 436.71 MB -100.0%
part.vortex 10.0 vortex-file-compressed 53.62 MB 0 B 53.62 MB -100.0%
partsupp.vortex 10.0 vortex-file-compressed 240.78 MB 0 B 240.78 MB -100.0%
region.vortex 10.0 vortex-file-compressed 6.91 KB 0 B 6.91 KB -100.0%
supplier.vortex 10.0 vortex-file-compressed 5.69 MB 0 B 5.69 MB -100.0%

Totals:

  • vortex-compact: 1.92 GB → 1.92 GB (0.0%)
  • vortex-file-compressed: 2.45 GB → 0 B (-100.0%)

@connortsui20 connortsui20 mentioned this pull request Aug 7, 2026
Closed
@connortsui20
Validate encoded RowFn output validity
eb4e035 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Clarify explicit RowFn adoption
90a97b3 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Tighten checked arithmetic contracts
878d22f 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Preserve containment with non-finite bounds
45aa5a3 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Share the RowFn vtable adapter
54f8efd 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Document primitive comparison paths
e7c8977 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Validate tensor row storage at runtime
b1ec2f3 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Use the shared RowFn vtable in benchmarks
a50f375 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Avoid allocating numeric execution arguments
2d3cf47 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Polish the RowFn vtable adapter
ee0c12b 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Enforce LaneZip length equality in release builds
882160b 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Repair RowFn benchmark revision comparisons
e2f4a2b 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Explain signed multiplication overflow probes
2029bef 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Polish primitive comparison execution
8d3357a 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
fixup! Execute tensor L2 norm with RowFn
409dd4f 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
fixup! Execute tensor product functions with RowFn
9354a25 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
fixup! Execute tensor L2 norm with RowFn
10977c4 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
fixup! Exercise both primitive comparison paths
15fef92 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
fixup! Execute spatial predicates with RowFn
b05b965 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Merge remote-tracking branch 'origin/develop' into ct/row-fn
3857096 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>

# Conflicts:
#	vortex-spatial/src/scalar_fn/execute.rs
#	vortex-spatial/src/scalar_fn/mod.rs
@connortsui20
Merge remote-tracking branch 'origin/develop' into ct/row-fn
0650a3f 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Merge remote-tracking branch 'origin/develop' into ct/row-fn
7c1851d 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>

# Conflicts:
#	vortex-compute/src/lane_kernels/source.rs
@connortsui20
Simplify the RowFn public API
4c7c4b9 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Avoid cloning primitive comparison constants
83037fe 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Update tensor L2 for the RowFn API
da911cd 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Update tensor products for the RowFn API
de47545 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Update spatial distance for RowFn views
f56bf93 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Use the blanket RowFn vtable for spatial predicates
bae08f6 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Use the blanket RowFn vtable in benchmarks
1d9fba6 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Finish the RowFn umbrella cleanup
7b3c404 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

changelog/performance A performance improvement experimental Experimental change; requires broader validation

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@connortsui20